All pull requests

Pull requests

• [https://nvbugs/6891165][fix] Pass chat_template_kwargs in the request body of the JSON-schema serve example

  #21026·JunyiXu-nv opened Oct 26, 2026Collaborator·1 task done·

  ·
  3

  

• [None][fix] DeepSeek DSML tool parsers: keep string parameter values as written

  #21025·JunyiXu-nv opened Oct 26, 2026Collaborator·1 task done·

  ·
  3

  

• [TRTLLM-17005][refactor] Component-local C++ Tests (Part 5)

  #21024·Funatiq opened Oct 26, 2026Collaborator·1 task·

  ·
  2

  

• [https://nvbugs/6919850][fix] Cap V2 KV cache estimation host tiers

  #21023·trtllm-agent opened Oct 26, 2026Collaborator·

  ·
  3

  

• [TRTLLM-17005][refactor] Component-local C++ Tests (Part 3a)

  #21022·Funatiq opened Oct 26, 2026Collaborator·1 task·

  ·
  6

  

• [TRTLLM-17229][feat] Extend the mixed-precision KV cache to speculative decoding and the sparse MLA backends

  api-compatible
  #21021·Hudayday opened Oct 26, 2026Collaborator·

  ·
  14

  

• [None][perf] JIT compile ahead and tune ahead for Nemotron-H models

  #21020·chenfeiz0326 opened Oct 26, 2026Collaborator·1 task done·

  ·
  13

  

• [None][feat] ModelingV2: GLM-5.3-Flash-NVFP4 on sm_10x (B200, GB300), tp4 with MTP

  #21019·kaiyux opened Oct 26, 2026Member·1 task done·

  ·
  8

  

• [#21014][fix] DeepSeek DSML tool parsers: match closing tags structurally

  #21018·lucifer1004 opened Oct 26, 2026Collaborator·6 tasks done·

  ·
  1

  

• [Do NOT Merge][Preview branches] DeepSeek-V4.1-Flash performance optimization

  #21017·zhenhuaw-me opened Oct 26, 2026Member·1 task done·

  ·
  

• [None][test] Add coverage for Qwen4ExpForConditionalGeneration

  #21015·StanleySun639 opened Oct 26, 2026Collaborator·1 task done·

  ·
  7

  

• [TRTLLM-17328][chore] Remove quantized FlashInfer TRTLLM-Gen MoE leaves and FlashInfer two-sided alltoall

  #21013·rosong11 opened Oct 26, 2026Collaborator·1 task done·

  ·
  6

  

• [None][feat] Dense DWDP for Kimi-K3 context servers and a balanced DWDP expert partition

  #21012·zongfeijing opened Oct 26, 2026Collaborator·1 task·

  ·
  

• [None][fix] Kimi K3 attn_res persistent fused kernel: 64-bit candidate offsets above the int range

  #21011·zongfeijing opened Oct 26, 2026Collaborator·1 task done·

  ·
  3

  

• [TRTLLM-17337][infra] Schedule post-merge perf-sanity by build ID; skip it in PR --post-merge runs

  #21010·chenfeiz0326 opened Oct 26, 2026Collaborator·1 task done·

  ·
  7

  

• [TRTLLMINF-400][infra] Refresh TOT waives from OpenDB before final test failure

  #21009·hanjingtian opened Oct 26, 2026Collaborator·3 tasks done·

  ·
  

• [None][infra] Add a probe workflow for running Check Test List on Git…

  #21008·EmmaQiaoCh opened Oct 26, 2026Collaborator·1 task·

  ·
  4

  

• [https://nvbugs/6971730][fix] Keep Inductor's async-compile pool alive

  #21007·yuxianq opened Oct 26, 2026Collaborator·1 task done·

  ·
  4

  

• [#21004][fix] DeepSeek V3 and V3.1 tool parsers: complete a tool call that ends in the last delta

  #21005·LeizhenZhang opened Oct 26, 2026·1 task done·

  ·
  1

  1

  

• [https://nvbugs/6770977][test] Cherry-pick #21002 to release/1.3: Fix qwen3_32b_fp8 disagg output check and startup budget

  #21003·chuangz0 opened Oct 26, 2026Collaborator·1 task·

  ·
  1

  

• [https://nvbugs/6770977][test] Fix qwen3_32b_fp8 disagg output check and startup budget

  ci: full pre-merge approved
  #21002·chuangz0 opened Oct 26, 2026Collaborator·1 task·

  ·
  5

  

• Feat/kv owner layouts

  #21001·allisonlim-nv opened Oct 26, 2026Contributor·1 task·

  ·
  

• [https://nvbugs/6981910][fix] Unwaive test_forward_error_survival on CPU

  #21000·trtllm-agent opened Oct 26, 2026Collaborator·

  ·
  1

  

• [None][test] Prepare GLM-5.3 B200 performance onboarding

  #20999·yufeiwu-nv opened Oct 26, 2026Collaborator·1 task done·

  ·
  

• [None][perf] GVR V2 top-K: route K=2048 rows to the clustered register path

  #20998·longcheng-nv opened Oct 26, 2026Collaborator·1 task done·

  ·
  11