Commits · 0377802c20df2528d895add1f9918b2c7b868eb0 · OpenDAS / vllm_cscc

12 Sep, 2025 18 commits

[Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548) · 0377802c
Flora Feng authored Sep 12, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
0377802c
[Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
72fc8aa4
[sleep mode] save memory for on-the-fly quantization (#24731) · fdb09c77
youkaichao authored Sep 12, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
fdb09c77
[Kernel] [CPU] refactor `cpu_attn.py:_run_sdpa_forward` for better memory access (#24701) · 7a1c4025
Ignacio Sica authored Sep 12, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
```
7a1c4025
[Bugfix] Fix BNB name match (#24735) · 60a09519
Jee Jee Li authored Sep 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
60a09519

[Misc][gpt-oss] Add gpt-oss label to PRs that mention harmony or related to... · 64d90c3e

Chen Zhang authored Sep 12, 2025


[Misc][gpt-oss] Add gpt-oss label to PRs that mention harmony or related to builtin tool call (#24717)
Signed-off-by: Chen Zhang <zhangch99@outlook.com>

64d90c3e

[CI/Build] Skip prompt embeddings tests on V1-only CPU backend (#24721) · 59d5d2c7
Li, Jiang authored Sep 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
59d5d2c7
[CI] Add ci_envs for convenient local testing (#24630) · d21a36f5
wang.yuqi authored Sep 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
d21a36f5

[CI] Fix flaky test ... · 561a0bae

Chen Zhang authored Sep 12, 2025


[CI] Fix flaky test  v1/worker/test_gpu_model_runner.py::test_kv_cache_stride_order          (#24640)
Signed-off-by: Chen Zhang <zhangch99@outlook.com>

561a0bae

[BugFix] Fix Qwen3-Next PP (#24709) · f592b317
Nick Hill authored Sep 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
f592b317
[Bugfix] Fix MRoPE dispatch on CPU (#24712) · 7920de0a
Li, Jiang authored Sep 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
7920de0a

Fix implementation divergence for BLOOM models between vLLM and HuggingFace... · ddcec289

Andrew Sansom authored Sep 11, 2025


Fix implementation divergence for BLOOM models between vLLM and HuggingFace when using prompt embeds (#24686)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>

ddcec289

Enable conversion of multimodal models to pooling tasks (#24451) · e090b7b4
Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
e090b7b4
[DOCs] Update ROCm installation docs section (#24691) · 6a50eaa0
Gregory Shtrasberg authored Sep 11, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
6a50eaa0
[Qwen3-Next] MoE configs for H20 TP=1,2,4,8 (#24707) · 12a8414d
Jee Jee Li authored Sep 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
12a8414d
[Bugfix] fixes the causal_conv1d_update kernel update non-speculative decoding cases (#24680) · 880c741b
Tao He authored Sep 12, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
880c741b

[V1] feat:add engine v1 tracing (#20372) · 40b6c912

RichardoMu authored Sep 12, 2025


Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
Signed-off-by: Ye Zhang <zhysishu@gmail.com>
Signed-off-by: RichardoMu <44485717+RichardoMrMu@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Ye Zhang <zhysishu@gmail.com>
Co-authored-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: 瑜琮 <ly186375@antfin.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

40b6c912

[Startup] Make DeepGEMM warmup scale with max-num-batched-tokens (#24693) · 2e6bc468
Lucas Wilkinson authored Sep 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
2e6bc468

11 Sep, 2025 22 commits
- [Bug] Fix Layer `weight_block_size` Assertion Issue (#24674) · fcba05c4
  Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  fcba05c4
- [Doc] Clarify cudagraph capture size logic and default behavior in scheduler (#18698) · 7a30fa87
  Zazzle516 authored Sep 12, 2025
```
Signed-off-by: Zazzle516 <2405677060@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7a30fa87
- [Qwen3-Next] MOE configs for H100 TP4 (#24699) · f82f7a89
  Chen Zhang authored Sep 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f82f7a89
- [Perf] Use upstream CUTLASS for SM90 Block FP8 kernel (#23280) · c3aea10d
  Michael Goin authored Sep 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c3aea10d
- [Bugfix][Attention] Fix FlashInfer MLA block size logic (#24692) · d4fd2768
  Matthew Bonanni authored Sep 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  d4fd2768
- [Qwen3-Next] Add B200 MoE configs for Qwen3-next (#24698) · 7a70a718
  Vadim Gimpelson authored Sep 12, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  7a70a718
- [CI/Build] Add bc-linter to vLLM CI (#21234) · 7d465199
  Zhewen Li authored Sep 11, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  7d465199
- [Qwen3-Next] MoE configs for H200 TP=1,2,4 (#24695) · 569bf1c9
  Woosuk Kwon authored Sep 11, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  569bf1c9
- [Bugfix] Set `VLLM_ALLREDUCE_USE_SYMM_MEM` default to False (#24696) · 1ec20355
  Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1ec20355
- [flashinfer] [kernel] support for fp8 kv cache for trtllm prefill attention (#24197) · e42af78b
  Xiaozhu Meng authored Sep 11, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
```
  e42af78b
- [Kernel][B200] `mxfp4` fused cutlass moe (#23696) · 074854b2
  Duncan Moss authored Sep 11, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  074854b2
- Update Spec Decode metrics to include drafted and accepted token throughput (#24127) · 79ac59f3
  Andrew Xia authored Sep 11, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  79ac59f3
- [BugFix] Fix tokenize asyncio task leak (#24677) · b971f915
  Nick Hill authored Sep 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b971f915
- [Qwen3-Next] Add MoE Config for H200 (#24688) · c733bd5e
  Woosuk Kwon authored Sep 11, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  c733bd5e
- [Doc] Remove Useless Comments (#24687) · a892b259
  Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a892b259
- [Ultravox] Use wrapped_model_config to instantiate inner model (#24679) · 127ded0a
  Peter Salas authored Sep 11, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  127ded0a
- [VLM] Migrate remain DP-supported ViT models to use `disable_tp` (#24363) · bb2b5126
  Isotr0py authored Sep 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  bb2b5126
- [Docs] Fix formatting of transcription doc (#24676) · 361ae27f
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  361ae27f
- fix some typos (#24616) · e26fef83
  co63oc authored Sep 12, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  e26fef83
- Fix model name included in responses (#24663) · c1eda615
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c1eda615
- [Bugfix] Fix platform-specific routing in CustomOp implementations (#24444) · 4aa23892
  Konrad Zawora authored Sep 11, 2025
```
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
```
  4aa23892
- [Kernels] Enable Torch Symmetric Memory All-Reduce By Default (#24111) · 1fdd5c42
  Ilya Markov authored Sep 11, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  1fdd5c42