Skip to content

chunking/streaming revisited#1173

Open
cjpais wants to merge 4 commits intomainfrom
chunking
Open

chunking/streaming revisited#1173
cjpais wants to merge 4 commits intomainfrom
chunking

Conversation

@cjpais
Copy link
Copy Markdown
Owner

@cjpais cjpais commented Mar 28, 2026

No description provided.

@cjpais cjpais mentioned this pull request Mar 28, 2026
@ferologics
Copy link
Copy Markdown
Contributor

Local validation note: I tested this against the original long Parakeet failure case on my machine (handy-1774637386.wav, 1163.58s / 18,617,280 samples) using the same chunked batch transcription path/config this PR adds for long history retries.

Result: it completed successfully with parakeet-tdt-0.6b-v3 instead of hitting the previous broadcast-shape inference failure.

On my machine that run finished in ~48.5s end-to-end for the transcription step.

So at least for the failure that prompted my earlier #1166, this looks like it resolves the issue in practice.

DylPorter added a commit to DylPorter/Handy that referenced this pull request Apr 17, 2026
After rebasing cjpais PR cjpais#1173 onto main, resolve the few pieces that
drifted in the 3 weeks the PR was stalled:

- transcription.rs: add LoadedEngine::Cohere match arm in with_engine()
  (Cohere variant was added to main after the PR branched)
- actions.rs: drop stale paste_time.elapsed() reference in paste success
  log (timer was removed on the streaming branch)
- tauri.conf.json: swap bun -> npm for before{Dev,Build}Command so the
  project builds without installing bun
- bindings.ts: regenerate via tauri-specta to pick up new streaming
  commands (changeTranscriptionModeSetting, changeRealtimeChunkDurationSetting)
- Cargo.lock: regenerate after transcribe-rs 0.3.4 -> 0.3.8 bump
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants