-
Notifications
You must be signed in to change notification settings - Fork 46
docs(ai-transport): add roadmap page #3449
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
+62
−0
Merged
Changes from 4 commits
Commits
Show all changes
5 commits
Select commit
Hold shift + click to select a range
43ee001
docs(ai-transport): add roadmap page
rainbowFi 7a836a0
docs(ai-transport): refine roadmap intro and contact prompt
rainbowFi a5667f1
docs(ai-transport): move roadmap under getting started nav, update co…
rainbowFi e5a5748
docs(ai-transport): clarify next section description
rainbowFi dcb0d4e
docs(ai-transport): expand future section descriptions
rainbowFi File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,58 @@ | ||
| --- | ||
| title: "AI Transport roadmap" | ||
| meta_description: "The AI Transport roadmap across three horizons: capabilities available now, capabilities in active development, and capabilities planned for the future." | ||
| meta_keywords: "AI Transport, roadmap, durable sessions, AI infrastructure, token streaming, human handover, durable execution" | ||
| intro: "AI Transport is under active development with new releases shipping regularly" | ||
| --- | ||
|
|
||
| This page shows where AI Transport is heading. The roadmap is dynamic and updated based on the feedback received from customers. The fastest way to influence this roadmap is to [contact Ably](https://ably.com/contact), explaining what you are trying to build and where AI Transport can help you. | ||
|
|
||
| ## Delivered <a id="delivered"/> | ||
|
|
||
| Available today. | ||
|
|
||
| | Capability | Description | | ||
| | --- | --- | | ||
| | [Resumable token streaming](/docs/ai-transport/features/token-streaming) | Tokens stream over a session rather than a single HTTP request, so a dropped connection resumes mid-response with nothing lost or duplicated, and a reconnecting client catches up automatically. | | ||
| | [Connection resilience](/docs/ai-transport/features/reconnection-and-recovery) | Realtime delivery over WebSocket with automatic fallback to HTTP streaming and long-polling, so streams survive proxies, firewalls, and unreliable networks. | | ||
| | [Multi-device session continuity](/docs/ai-transport/features/multi-device) | The same session opens on any device the user picks up, with the full conversation and current state. | | ||
| | [Persistent history and replay](/docs/ai-transport/features/history) | Conversations survive disconnects and stay available as history, for resumption, audit, and review. | | ||
| | Bidirectional control | Any client signals the agent through the session, so a user can [cancel generation](/docs/ai-transport/features/cancellation), [interrupt](/docs/ai-transport/features/interruption), [send again while the agent responds](/docs/ai-transport/features/double-texting), and keep interacting rather than only consuming a one-way stream. | | ||
| | [Conversation branching](/docs/ai-transport/features/branching) | Edit and regenerate messages, with each branch kept in the session tree. | | ||
| | Client-side tool calls and approval gates | Call [client tools](/docs/ai-transport/features/tool-calling) over the session, with [human-in-the-loop](/docs/ai-transport/features/human-in-the-loop) approval where you need it. | | ||
| | Drop-in framework integration | A drop-in transport for the [Vercel AI SDK](/docs/ai-transport/getting-started/vercel-ai-sdk), plus the [Core SDK](/docs/ai-transport/getting-started/core-sdk) for everything else. | | ||
| | Shared live state and presence | [Agent presence](/docs/ai-transport/features/agent-presence) and [shared session state](/docs/ai-transport/features/liveobjects) exposed directly through the SDK. | | ||
| | Enterprise-ready platform | SOC 2 Type II and HIPAA, on Ably's realtime [infrastructure](/docs/ai-transport/concepts/infrastructure). | | ||
|
|
||
| ## Now <a id="now"/> | ||
|
|
||
| Actively building. | ||
|
|
||
| | Capability | Description | | ||
| | --- | --- | | ||
| | Durable execution support | Pair durable sessions with [Temporal](https://temporal.io/) and [Vercel Workflow SDK](https://workflow-sdk.dev/), so the workflow and the user experience are both crash-proof. | | ||
| | Human and AI handover | Transfer a conversation between an AI and a human agent and back again using the AI Transport SDK, with live supervision and escalation. | | ||
| | Mid-session steering | Redirect or steer the agent while it responds. | | ||
| | Increased ecosystem support | Native integrations for OpenAI and Anthropic, so more of the ecosystem is a drop-in. | | ||
|
|
||
| ## Next <a id="next"/> | ||
|
|
||
| Coming up - unlikely to change. | ||
|
|
||
| | Capability | Description | | ||
| | --- | --- | | ||
| | Push notifications through the AI Transport SDK | Reach users when they are away, including iOS Live Activities for long-running tasks, without using the Pub/Sub SDK. | | ||
| | Increased language support | AI Transport SDK implementation in Python. | | ||
| | Ably [Chat SDK](/docs/chat) integration | A clean path from chat use cases into AI Transport. | | ||
|
|
||
| ## Future <a id="future"/> | ||
|
|
||
| Planned and exploring. If you care about one of these features then [contact Ably](https://ably.com/contact), explaining what you are trying to build and where AI Transport can help you. | ||
|
|
||
| | Capability | Description | | ||
| | --- | --- | | ||
| | Increased language support | Java, Swift, Kotlin, and .NET. | | ||
| | Expanded ecosystem support | Gemini, LangChain and LangGraph, TanStack AI, AG-UI, Vue, and Svelte. | | ||
| | Sub-agent orchestration | Better primitives for coordinating multiple sub-agents in a single Run. | | ||
| | More durable-execution integrations | Inngest and trigger.dev. | | ||
| | Multimodal | Audio and video delivery, and integrations with voice providers. | | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.