Commits · 352b90c4a4f2af1d75cdc09fecf30a47a4ca39fb · OpenDAS / vllm_cscc

24 Mar, 2026 3 commits
- [KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend... · e3c6c10c
  Ronen Schaffer authored Mar 24, 2026
```
[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into `cpu/` package (#37874)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
```
  e3c6c10c
- [V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c59a132f
- [Test] E2E Nemotron-3-Super tests (#36803) · 56777b5c
  roikoren755 authored Mar 24, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  56777b5c
23 Mar, 2026 9 commits

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

[Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
38364a7e

[Async][Spec Decoding] Zero-bubble async scheduling + spec decoding (#32951) · fafe76b4

Matthew Bonanni authored Mar 23, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Co-authored-by: zhrrr <43847754+izhuhaoran@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

fafe76b4

[CI][PD] Add Hybrid SSM integration tests to CI (#37657) · 1cbbcfe8
Nicolò Lucchesi authored Mar 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
1cbbcfe8
[Feature] ViT Full CUDA Graph (#35963) · f85e479e
Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
f85e479e
[CI/Build][LoRA] Update Qwen35 LoRA testing (#37816) · 1f0d2106
Jee Jee Li authored Mar 23, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1f0d2106
[Test] Consolidate tool parser unit tests to tests/tool_parsers (#37834) · 3bbe2e1e
Ben Browning authored Mar 23, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
3bbe2e1e

always use `embed&token_classify` for bge-m3 (#37632) · 6e04e793

Augusto Yao authored Mar 23, 2026


Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

6e04e793

Fix AudioFlamingo3/MusicFlamingo HF parity and RoTE handling (#37643) · e7767ecc
Lasha Koroshinadze authored Mar 22, 2026
```
Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
```
e7767ecc

22 Mar, 2026 8 commits
- [Test] Only Run MLA model when user explicitly set for batch invariance (#37719) · eaf49786
  Wentao Ye authored Mar 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eaf49786
- [ROCm][CI] Stabilize ROCm speech-to-text translation test with lower min acc threshold (#37723) · cd1242d8
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  cd1242d8
- [MoE] Move PF Methods to Folder (#35927) · 4383f153
  Robert Shaw authored Mar 22, 2026
  
  4383f153
- [ROCm][CI] get_cu_count was renamed to num_compute_units in #35042 (#37764) · 6ecba840
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6ecba840
- [ROCm][CI] Fix MEGA_AOT_ARTIFACT fallback when PyTorch < 2.10.0 lacks AOT support (#37763) · 3b06c55c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3b06c55c
- [CI] Skip ISAAC multimodal tests due to broken upstream HF model weights (#37781) · c862481c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c862481c
- [ROCm][CI] Add large_gpu_mark to test_max_tokens_none for ROCm (#37717) · c86b17cf
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c86b17cf
- [Bugfix] Fix pooling non-determinism from pinned prompt_lens aliasing (#37775) · 66f927f2
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  66f927f2
21 Mar, 2026 9 commits
- [MoE] Move FlashInfer CuteDSL experts into fused_moe/experts/ (#37759) · 6b2fa3a7
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
  6b2fa3a7
- [Quantization][Deprecation] Remove PTPC FP8 (#32700) · eeee5b26
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  eeee5b26
- Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884
  Brandon Pelfrey authored Mar 21, 2026
```
Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  80b70884
- [Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318) · 298e5108
  Francesco Fusco authored Mar 21, 2026
```
Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>
```
  298e5108
- [ROCm][CI] Mark gemma3 as large GPU test to avoid OOM on MI250 (#37610) · 0d50fa1d
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  0d50fa1d
- Revert "[compile] Initialize passes at VllmBackend init" (#37733) · 1fa1e53a
  Simon Mo authored Mar 20, 2026
  
  1fa1e53a
- [ROCm][CI] Guard CudaPlatform/RocmPlatform imports to fix test collection on... · 3ffa5200
  Andreas Karatzas authored Mar 20, 2026
```
[ROCm][CI] Guard CudaPlatform/RocmPlatform imports to fix test collection on cross-platform builds (#37617)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3ffa5200
- [MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189
  Yongye Zhu authored Mar 20, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  87bd9189
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
20 Mar, 2026 11 commits
- [Model Runner V2] Support Streaming Inputs (#37028) · 85f671b8
  Santino Ramos authored Mar 20, 2026
```
Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>
```
  85f671b8
- [Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605) · 4f16ebbb
  Vadim Gimpelson authored Mar 20, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4f16ebbb
- [compile] Initialize passes at VllmBackend init (#35216) · 12fd17eb
  Angela Yi authored Mar 20, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  12fd17eb
- [Attention] Support distinguishing between short extends and decodes (#37303) · e1d85e5c
  Lucas Wilkinson authored Mar 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e1d85e5c
- [Perf] Eliminate redundant SparseMatrix creation in gpt_oss_triton_kernels (#37683) · d0532bf3
  Xin Yang authored Mar 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d0532bf3
- [ROCm][CI] Fix accuracy for llama-nemotron-vl pooling tests (#37613) · fb4e8bf4
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  fb4e8bf4
- Fix various config related issues for Transformers v5 (#37681) · 6ade4bc5
  Harry Mellor authored Mar 20, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6ade4bc5
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709) · 1779c098
  L.B.R. authored Mar 20, 2026
```
Signed-off-by: L.B.R. <lbr@mmonad.com>
Co-authored-by: L.B.R. <lbr@mmonad.com>
```
  1779c098
- [Model] Add LFM2-ColBERT-350M support (#37528) · 8b6c6b95
  Ilya Boytsov authored Mar 20, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
```
  8b6c6b95