docs(realtime): describe the lazy Gemini Live setup built from the first session.update - #1216
Open
mateo-berri wants to merge 2 commits into
Open
docs(realtime): describe the lazy Gemini Live setup built from the first session.update#1216mateo-berri wants to merge 2 commits into
mateo-berri wants to merge 2 commits into
Conversation
…rst session.update
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Contributor
Author
|
bugbot run |
…erges into the Gemini Live setup
Contributor
Author
|
bugbot run |
There was a problem hiding this comment.
✅ Bugbot reviewed your changes and found no new issues!
Comment @cursor review or bugbot run to trigger another review on this PR
Reviewed by Cursor Bugbot for commit 6a8e189. Configure here.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TLDR
session.update, sooutput_modalitiesandmodalitiesapplysession.created, thesession.updatedacknowledgement, and the text-to-audio downgrade on audio-only modelsLITELLM_GEMINI_LIVE_DEFER_SETUProw to the config settings tablePairs with BerriAI/litellm#39864 (LIT-6974)
Merge after BerriAI/litellm#39864 lands, since these pages describe behavior that only exists once that PR ships
Type
📖 Documentation
Note
Low Risk
Documentation-only changes with no runtime impact; behavior described depends on the linked implementation PR landing first.
Overview
Updates Gemini and Vertex realtime provider docs and the
LITELLM_GEMINI_LIVE_DEFER_SETUPenv reference to match lazy Live setup behavior (companion implementation PR).session.updateis no longer described as ignored or connect-time-only: every update before the first content frame (conversation item, audio, or tool result) is merged into the single Gemini/Vertexsetup, withsession.updatedacknowledgement; updates after content are ignored because setup is one-shot per connection. Default path sends setup with the first content frame, using mergedsession.updatefields or model defaults when none were sent.gemini_live_defer_setupis reframed as optional (defaultfalse): enable it only when clients stream audio or text before theirsession.update, so LiteLLM buffers that early traffic until the update can still shape setup. Vertex docs also noteoutput_modalities: ["text"]on audio-only models is downgraded to audio with a proxy warning.Reviewed by Cursor Bugbot for commit 6a8e189. Bugbot is set up for automated code reviews on this repo. Configure here.