Commits · bcc6f67447e910c57b6986500cd7626e0974f8ef · OpenDAS / vllm_cscc · GitLab

30 Mar, 2026 34 commits
- [Bugfix] Use null block (0) for padded block table entries (#35431) · bcc6f674
  SandishKumarHN authored Mar 30, 2026
```
Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  bcc6f674
- [Bug fix][Quantization] Fix dummy weight loading (#38478) · 1fc69f59
  Asaf Gardin authored Mar 30, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  1fc69f59
- [ROCm][CI] Pin test_hybrid test to TRITON_ATTN on ROCm (#38381) · d9c7db18
  Micah Williamson authored Mar 30, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  d9c7db18
- [EPLB] Optmize eplb mapping and record in router for prefill (#36261) · 12701e8a
  Ilya Markov authored Mar 30, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  12701e8a
- [Feat][Spec Decode] DFlash (#36847) · 494636b2
  Benjamin Chislett authored Mar 30, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  494636b2
- [3/n] Migrate cutlass/scaled_mm_entry.cu torch stable ABI (#37221) · ab1a6a43
  mikaylagawarecki authored Mar 30, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  ab1a6a43
- [Refactor] Unify engine process monitoring in engine manager and add Ray backend support (#35862) · b5e60825
  fangyuchu authored Mar 31, 2026
```
Signed-off-by: fangyuchu <fangyuchu@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  b5e60825
- [Bugfix][MLA] Change default SM100 MLA prefill backend back to TRT-LLM (#38562) · 2c734ed0
  Matthew Bonanni authored Mar 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2c734ed0
- [HMA]Fix corner case when hybrid page_size can not be evenly divided issue... · 3b1dbaad
  Chendi.Xue authored Mar 30, 2026
```
[HMA]Fix corner case when hybrid page_size can not be evenly divided issue (blk_size=64,tp=4) (#37467)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  3b1dbaad
- [NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) · b4a2f3ac
  Johnny authored Mar 30, 2026
```
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
```
  b4a2f3ac
- [Mamba] Add stochastic rounding support (#35753) · 8e6293e8
  roikoren755 authored Mar 30, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  8e6293e8
- [ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698) · dbdd9ae0
  Hongxia Yang authored Mar 30, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  dbdd9ae0
- [Bugfix] Handle ParallelLMHead in compressed-tensors get_quant_method (#37291) · e8b055a5
  Matthias Gehre authored Mar 30, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e8b055a5
- [Misc] Add @tomeras91 as a maintainer of Nemotron related code + mamba block (#38547) · 246dc7d8
  tomeras91 authored Mar 30, 2026
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  246dc7d8
- [Bugfix] Remove false-positive format mismatch warnings in FLA ops (#38255) · 7c3f88b2
  Thomas Parnell authored Mar 30, 2026
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  7c3f88b2
- [Bugfix][CPU] Skip set_num_threads after thread binding (#38535) · 6557f493
  Li, Jiang authored Mar 30, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6557f493
- [Core][CI] Add opt-in media URL caching via VLLM_MEDIA_CACHE (#37123) · 677424c7
  Andreas Karatzas authored Mar 30, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  677424c7
- Fix ambiguous num_blocks for hybrid attn mamba (#37236) · 1031c84c
  Collin McCarthy authored Mar 30, 2026
```
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  1031c84c
- [Bugfix][Frontend] Return 400 for corrupt/truncated image inputs instead of 500 (#38253) · 7e76af14
  aliialsaeedii authored Mar 30, 2026
```
Signed-off-by: aliialsaeedii <ali.al-saeedi@nscale.com>
```
  7e76af14
- [Bugfix] Fix shared-object aliasing in n>1 streaming with tool calls (#38158) · 3683fe6c
  yzong-rh authored Mar 30, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  3683fe6c
- [Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8
  Nicolò Lucchesi authored Mar 30, 2026
```
[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  cc06b4e8
- [ROCm] [DOC] Update the Documentation to include ROCm Nightly Wheel support (#38457) · 03ac6ca8
  TJian authored Mar 30, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  03ac6ca8
- [CI] Fix SPLADE pooler test broken by #38139 (#38495) · a08b7733
  haosdent authored Mar 30, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a08b7733
- [ROCm] Enable MORI EP for unquantized MoE with AITER backend (#37529) · 85c0950b
  Tan Pin Siang authored Mar 30, 2026
```
Signed-off-by: Tan Pin Siang <pinsiang.tan@amd.com>
```
  85c0950b
- (security) Fix SSRF in batch runner download_bytes_from_url (#38482) · 57861ae4
  Juan Pérez de Algaba authored Mar 30, 2026
```
Signed-off-by: jperezde <jperezde@redhat.com>
```
  57861ae4
- [Bugfix][Model] Fix PixtralForConditionalGeneration LoRA (#36963) · ac30a831
  Jee Jee Li authored Mar 30, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  ac30a831
- [Model][Quantization] Add GGUF support for MiniMax-M2.1 (#36965) · 63babd17
  PikaPikachu authored Mar 30, 2026
```
Signed-off-by: kangletian <Letian.Kang@amd.com>
```
  63babd17
- [ci] Soft fail and disable retry for AMD build image job (#38505) · fec5aeca
  Kevin H. Luu authored Mar 29, 2026
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  fec5aeca
- [MoE] Add RoutingMethodType.Simulated to TRT-LLM FP8/NVFP4 kernel allowlists (#38329) · d816834c
  Jaewon authored Mar 29, 2026
```
Signed-off-by: Jaewon Lee <jaewon@meta.com>
```
  d816834c
- [Misc] Always use `forward_mulmat` for `Conv3d` on newer versions of torch. (#38487) · 92f0db57
  Roger Wang authored Mar 29, 2026
  
  92f0db57
- [CI] Add temperature=0.0, reduce max_tokens, and add debug prints to audio_in_video tests (#38492) · bea23536
  Andreas Karatzas authored Mar 30, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bea23536
- Add @ZJY0516 to CODEOWNERS (#38497) · c133f337
  Jiangyun Zhu authored Mar 30, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c133f337
- [Bugfix] Support multi-type params parsing for DeepSeek v3.2 (#33703) · a6db99ba
  Stanislav Kirillov authored Mar 30, 2026
```
Signed-off-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  a6db99ba
- [ROCm][CI] Enable hybrid chunked prefill test (#38317) · 4f2ed5fd
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f2ed5fd
29 Mar, 2026 6 commits
- [QeRL] Fix online quantized reloading (#38442) · d28d86e8
  Kyle Sayers authored Mar 29, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d28d86e8
- [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9%... · 995dea13
  Wentao Ye authored Mar 29, 2026
```
[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  995dea13
- [Transformers v5] fix missing pixtral/voxtral multimodal dispatch (#38410) · 8c0b6267
  allgather authored Mar 29, 2026
```
Signed-off-by: allgather <all2allops@gmail.com>
```
  8c0b6267
- [ROCm][CI] Fix cross-attention dispatch for encoder-decoder models (#38450) · 43cc5138
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  43cc5138
- [Spec Decode, BugFix] Propagate norm_before_fc from Eagle3 speculator (#38111) · 5b8c30d6
  Shubhra Pandit authored Mar 28, 2026
```
Signed-off-by: Shubhra Pandit <shubhra.pandit@gmail.com>
```
  5b8c30d6
- [Feature] Add Qwen3-ForcedAligner support via token classification pooling (#35367) · d39b8daf
  haosdent authored Mar 29, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  d39b8daf