Commits · 2e6bc4682181b2124beb71fc532cc12187cbceea · OpenDAS / vllm_cscc · GitLab

12 Sep, 2025 1 commit
- [Startup] Make DeepGEMM warmup scale with max-num-batched-tokens (#24693) · 2e6bc468
  Lucas Wilkinson authored Sep 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  2e6bc468
11 Sep, 2025 39 commits
- [Bug] Fix Layer `weight_block_size` Assertion Issue (#24674) · fcba05c4
  Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  fcba05c4
- [Doc] Clarify cudagraph capture size logic and default behavior in scheduler (#18698) · 7a30fa87
  Zazzle516 authored Sep 12, 2025
```
Signed-off-by: Zazzle516 <2405677060@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7a30fa87
- [Qwen3-Next] MOE configs for H100 TP4 (#24699) · f82f7a89
  Chen Zhang authored Sep 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f82f7a89
- [Perf] Use upstream CUTLASS for SM90 Block FP8 kernel (#23280) · c3aea10d
  Michael Goin authored Sep 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c3aea10d
- [Bugfix][Attention] Fix FlashInfer MLA block size logic (#24692) · d4fd2768
  Matthew Bonanni authored Sep 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  d4fd2768
- [Qwen3-Next] Add B200 MoE configs for Qwen3-next (#24698) · 7a70a718
  Vadim Gimpelson authored Sep 12, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  7a70a718
- [CI/Build] Add bc-linter to vLLM CI (#21234) · 7d465199
  Zhewen Li authored Sep 11, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  7d465199
- [Qwen3-Next] MoE configs for H200 TP=1,2,4 (#24695) · 569bf1c9
  Woosuk Kwon authored Sep 11, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  569bf1c9
- [Bugfix] Set `VLLM_ALLREDUCE_USE_SYMM_MEM` default to False (#24696) · 1ec20355
  Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1ec20355
- [flashinfer] [kernel] support for fp8 kv cache for trtllm prefill attention (#24197) · e42af78b
  Xiaozhu Meng authored Sep 11, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
```
  e42af78b
- [Kernel][B200] `mxfp4` fused cutlass moe (#23696) · 074854b2
  Duncan Moss authored Sep 11, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  074854b2
- Update Spec Decode metrics to include drafted and accepted token throughput (#24127) · 79ac59f3
  Andrew Xia authored Sep 11, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  79ac59f3
- [BugFix] Fix tokenize asyncio task leak (#24677) · b971f915
  Nick Hill authored Sep 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b971f915
- [Qwen3-Next] Add MoE Config for H200 (#24688) · c733bd5e
  Woosuk Kwon authored Sep 11, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  c733bd5e
- [Doc] Remove Useless Comments (#24687) · a892b259
  Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a892b259
- [Ultravox] Use wrapped_model_config to instantiate inner model (#24679) · 127ded0a
  Peter Salas authored Sep 11, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  127ded0a
- [VLM] Migrate remain DP-supported ViT models to use `disable_tp` (#24363) · bb2b5126
  Isotr0py authored Sep 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  bb2b5126
- fix some typos (#24616) · e26fef83
  co63oc authored Sep 12, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  e26fef83
- Fix model name included in responses (#24663) · c1eda615
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c1eda615
- [Bugfix] Fix platform-specific routing in CustomOp implementations (#24444) · 4aa23892
  Konrad Zawora authored Sep 11, 2025
```
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
```
  4aa23892
- [Kernels] Enable Torch Symmetric Memory All-Reduce By Default (#24111) · 1fdd5c42
  Ilya Markov authored Sep 11, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  1fdd5c42
- [VLM] Optimize GLM4.5-V-style video processing to only decode necessary frames (#24161) · bcbe2a4d
  Isotr0py authored Sep 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  bcbe2a4d
- [Bugifx] Fix qwen-next packed_modules_mapping (#24656) · 817beef7
  Jee Jee Li authored Sep 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  817beef7
- [HybridKVCache][Platform] Add support_hybrid_kv_cache for platform (#24646) · 4f6593b0
  Mengqing Cao authored Sep 11, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  4f6593b0
- Allow users to specify kv cache memory size (#21489) · 94e6b2d5
  Boyuan Feng authored Sep 11, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  94e6b2d5
- Move `LoRAConfig` from `config/__init__.py` to `config/lora.py` (#24644) · 5f5271f1
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f5271f1
- Fix typing for `safetensors_load_strategy` (#24641) · d6249d06
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6249d06
- [CI Failure] fix models/language/pooling/test_auto_prefix_cache_support.py (#24636) · 25bb9e8c
  wang.yuqi authored Sep 11, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  25bb9e8c
- [Bugfix] Fix _synced_weight_loader (#24565) · ed5ae4aa
  Kyuyeun Kim authored Sep 11, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  ed5ae4aa
- [Bugfix] Fix incorrect import of CacheConfig (#24631) · 6aeb1dab
  Cyrus Leung authored Sep 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6aeb1dab
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9
- [torchao] Support quantization configs using module swap (#21982) · 2048c4e3
  Jerry Zhang authored Sep 10, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  2048c4e3
- Remove redundant all gather + split (#23441) · d1336018
  Chenxi Yang authored Sep 10, 2025
```
Co-authored-by: Chenxi Yang <cxyang@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  d1336018
- [Model] New model support for Motif-1-Tiny (#23414) · 9bd831f5
  TaehyunKim authored Sep 11, 2025
```
Signed-off-by: ca1207 <ca1207zzz@gmail.com>
Signed-off-by: TaehyunKim <73943231+ca1207@users.noreply.github.com>
Co-authored-by: WyldeCat <skan1543@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9bd831f5
- [Doc]: fixing doc typos (#24635) · e2b1f863
  Didier Durand authored Sep 11, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  e2b1f863
- [Core] feat: Add --safetensors-load-strategy flag for faster safetensors... · 41329a0f
  shengshiqi-google authored Sep 11, 2025
```
[Core] feat: Add --safetensors-load-strategy flag for faster safetensors loading from Lustre (#24469)
Signed-off-by: Shiqi Sheng <shengshiqi@google.com>
Signed-off-by: shengshiqi-google <160179165+shengshiqi-google@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  41329a0f
- Enable --profile in 'vllm bench throughput' (#24575) · ee0bc5e1
  Tomas Ruiz authored Sep 11, 2025
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  ee0bc5e1
- Kimi K2 Fused MoE kernels Optimization configs (#24597) · 3d1393f6
  Saman A. Pour authored Sep 10, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  3d1393f6
- [Engine][Chore] use local variable and remove output var assignment (#24554) · 8a894084
  Guy Stone authored Sep 11, 2025
```
Signed-off-by: Guy Stone <guys@spotify.com>
```
  8a894084