Skip to content

[build] Sync sglang-kt submodule (v0.6.3)#2055

Merged
yyj6666667 merged 5 commits into
mainfrom
auto/sync-sglang
Jun 25, 2026
Merged

[build] Sync sglang-kt submodule (v0.6.3)#2055
yyj6666667 merged 5 commits into
mainfrom
auto/sync-sglang

Conversation

@github-actions

@github-actions github-actions Bot commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Automated sync of third_party/sglang submodule to latest main.

Old ref: 8b636f9008dbad58c0a8e481b03e794739e6c146
New ref: 5d6bef9f61637aaeaf047bf8209def2af3eaa83f
sglang-kt version: 0.6.3

Commits included

5d6bef9f6 fix(v4): auto-bump swa_full_tokens_ratio to fit chunks_in_flight (#60)
1344f647a fix: kt_ep_wrapper silently fails to import (#59)
37eecb4e9 Enable DeepSeek V4 Flash inference on Ampere GPUs (#58)

This PR was created automatically by the sync-sglang-submodule workflow.

Two fixes discovered when the workflow finally executed end-to-end on a
self-hosted runner for the first time:

* ``apt-get update && apt-get install`` runs as the runner OS user
  (yyj), not root, so it fails with EACCES on the dpkg lock. Replace
  it with a pre-flight check that the expected system packages
  (cmake, pkg-config; libhwloc-dev / libnuma-dev are linked into
  the wheel via auditwheel) are already on PATH. Operators
  preinstall these once when they provision the runner.
* ``pip install build wheel setuptools torch --index-url
  https://download.pytorch.org/whl/cu128`` pinned the *sole* index
  to PyTorch's; ``build``/``wheel``/``setuptools`` aren't there and
  the install failed with "No matching distribution". Split into two
  pip calls so PyPI (or the operator's configured PIP_INDEX_URL
  mirror) keeps serving the build toolchain.
Self-hosted runners often have a tight system disk (the qj5090 runner
this is being validated against had ~300MB free on /), so unpacking a
~11MB wheel (with six ~6MB .so variants) into /tmp produced a truncated
extraction and an opaque "Dynamic cudart found" error. Use
$RUNNER_TEMP which Actions wires to /mnt (or wherever the operator
points TMPDIR) and falls back to /tmp on hosted runners that don't
suffer the same constraint.
@yyj6666667 yyj6666667 merged commit 459df61 into main Jun 25, 2026
6 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants