Import useful upstream exo PRs#16

Merged

team-wcv merged 29 commits into

mainfrom

chore/import-useful-upstream-prs

May 9, 2026

Commits on May 9, 2026

persist node ids in .cache

Evanev7
authored and
jw-wcv
committed
feat: peer-to-peer model downloads over LAN

authored and
jw-wcv
committed
refactor: decouple peer discovery from worker state, add link prioritization

authored and
jw-wcv
committed
feat: EXO_KV_CACHE_BITS env var + step=16384 to keep QuantizedKVCache usable at long context

authored and
jw-wcv
committed
fix: skip KV cache quantization in single-node BatchGenerator mode

authored and
jw-wcv
committed
feat: add --trust-remote-code CLI flag for custom model tokenizers

authored and
jw-wcv
committed
fix: keep TRUST_REMOTE_CODE=True for built-in models

authored and
jw-wcv
committed
Reconcile worker instance backoff from state
jw-wcv
committed
Tune cluster liveness polling cadence
jw-wcv
committed
Gate RDMA placement on rdma_ctl state
jw-wcv
committed
Fix upstream port compatibility issues
jw-wcv
committed
Harden peer download port for current typing
jw-wcv
committed
Use current model directory for peer file server
jw-wcv
committed
fix(download): harden peer file serving
jw-wcv
committed
fix: make darwin mdns discovery reliable

AlexCheema
authored and
jw-wcv
committed
Guard quantized cache + integrity-check peer downloads
jw-wcv
committed
Mirror download_shard ignore_patterns and offline flag in peer path
jw-wcv
committed
PR #16 R3: skip HF integrity check in offline mode + per-process peer port
jw-wcv
committed
Pick RDMA edges and serve from every model dir for peer downloads
jw-wcv
committed
Reject oversized peer partials; relocate node-ID keypair to config dir
jw-wcv
committed
Scope node-ID keypair per process and migrate inside the file lock
jw-wcv
committed
Combine listening ports for keypair scope; restart on 200-on-resume
jw-wcv
committed
PR #16 R(N+8) P1: address libp2p-port=0 scope collision and oversized peer responses
jw-wcv
committed
PR #16 R(N+9) P1+P2: restore safer node timeout and search all model roots
jw-wcv
committed
PR #16 R(N+10) P2: keep peer file server task alive for cleanup
jw-wcv
committed
PR #16 R(N+10) P2: materialize zero-byte marker files in peer transfer
jw-wcv
committed
PR #16 R(N+11) P1: distinguish unknown-size from zero-byte in peer transfer
jw-wcv
committed
PR #16 R(N+13) P1: serialize legacy keypair adoption across scopes
jw-wcv
committed
PR #16 R(N+14) P2: mark zero-byte peer files complete in progress map
jw-wcv
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Import useful upstream exo PRs#16

Import useful upstream exo PRs#16
team-wcv merged 29 commits into
mainfrom
chore/import-useful-upstream-prs

Commits on May 9, 2026

persist node ids in .cache

feat: peer-to-peer model downloads over LAN

refactor: decouple peer discovery from worker state, add link prioritization

feat: EXO_KV_CACHE_BITS env var + step=16384 to keep QuantizedKVCache usable at long context

fix: skip KV cache quantization in single-node BatchGenerator mode

feat: add --trust-remote-code CLI flag for custom model tokenizers

fix: keep TRUST_REMOTE_CODE=True for built-in models

Reconcile worker instance backoff from state

Tune cluster liveness polling cadence

Gate RDMA placement on rdma_ctl state

Fix upstream port compatibility issues

Harden peer download port for current typing

Use current model directory for peer file server

fix(download): harden peer file serving

fix: make darwin mdns discovery reliable

Guard quantized cache + integrity-check peer downloads

Mirror download_shard ignore_patterns and offline flag in peer path

PR #16 R3: skip HF integrity check in offline mode + per-process peer port

Pick RDMA edges and serve from every model dir for peer downloads

Reject oversized peer partials; relocate node-ID keypair to config dir

Scope node-ID keypair per process and migrate inside the file lock

Combine listening ports for keypair scope; restart on 200-on-resume

PR #16 R(N+8) P1: address libp2p-port=0 scope collision and oversized peer responses

PR #16 R(N+9) P1+P2: restore safer node timeout and search all model roots

PR #16 R(N+10) P2: keep peer file server task alive for cleanup

PR #16 R(N+10) P2: materialize zero-byte marker files in peer transfer

PR #16 R(N+11) P1: distinguish unknown-size from zero-byte in peer transfer

PR #16 R(N+13) P1: serialize legacy keypair adoption across scopes

PR #16 R(N+14) P2: mark zero-byte peer files complete in progress map