Skip to content

fix(vllm): use max prompt length for batch context-length check #1209

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
JKDasondee wants to merge 1 commit into from
+3 −3

fix(vllm): use max prompt length for batch context-length check

55de7e2
Select commit
Loading
Failed to load commit list.
Closed

fix(vllm): use max prompt length for batch context-length check #1209

fix(vllm): use max prompt length for batch context-length check
55de7e2
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs