Commits · 608bb1446285db42fcc3aa33881c8c5dd0646ce0 · OpenDAS / vllm_cscc

08 Nov, 2025 4 commits

[Model] Consolidate Deepseek-MoE implementation with DeepSeek-v2 (#28101) · 934a9c3b

Isotr0py authored Nov 08, 2025


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

934a9c3b

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068) · d0c77920

Xiaohong (Sean) Chen authored Nov 07, 2025

Signed-off-by: Sean Chen <xiaohong_chen1991@hotmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>

d0c77920

remove resolve_op_overloads and use splitting_ops directly (#28081) · b158df28
Boyuan Feng authored Nov 07, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
b158df28
Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
811df41e

07 Nov, 2025 10 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319) · 67a2da89
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67a2da89
- [Core] Rework handling of async scheduling config (#28250) · da786e33
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da786e33
- [Bugfix] Fix and add tests for GptOss reasoning parser (#28000) · 18903216
  Benjamin Chislett authored Nov 07, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  18903216
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
- [Perf] Introduce FlattenLogprobs to store logprobs results to reduce GC overhead (#28171) · ccd98b59
  Jialin Ouyang authored Nov 07, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ccd98b59
- [CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all... · a736e5ff
  Copilot authored Nov 07, 2025
```
[CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all tests in nightly (#28074)
```
  a736e5ff
- Add runai model streamer e2e test for GCS (#28079) · a47d94f1
  Alexis MacAskill authored Nov 06, 2025
```
Signed-off-by: Alexis MacAskill <amacaskill@google.com>
```
  a47d94f1
- [CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (#28247) · e70fbc59
  Alex Brooks authored Nov 06, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Signed-off-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e70fbc59
- [Multimodal][torch.compile] Add compilation config field for turning off ViT/MM compile (#28242) · 4bf56c79
  Lucas Kabela authored Nov 06, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  4bf56c79
06 Nov, 2025 8 commits

Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483) · 59b453ea

Junhong Liu authored Nov 07, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>

59b453ea

Fix failing test for CRadio (#27738) · 827e4237

Eugene Khvedchenya authored Nov 07, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: wang.yuqi <noooop@126.com>

827e4237

[Test] Add non-MoE DP test coverage (#28235) · ca90f503
Matthew Bonanni authored Nov 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
ca90f503
[Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
59a50afa
[V0 deprecation]clean up is_v1_supported_oracle (#28116) · c3ee80a0
wangxiyuan authored Nov 06, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
c3ee80a0
Patch Mistral Tokenizer (#28146) · a404e2c0
Julien Denize authored Nov 06, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
a404e2c0
[CI] Add compile/test_multimodal_compile.py to CI (#28151) · bde50393
gmagogsfm authored Nov 05, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
bde50393

[CI Failure] `nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV` was removed from HF.... · f948ab69

Vadim Gimpelson authored Nov 06, 2025


[CI Failure] `nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV` was removed from HF. Skip it in tests (#28170)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>

f948ab69

05 Nov, 2025 13 commits
- [CI/Build] Fix `test_defaults_with_usage_context` in AMD CI (#27926) · 0b8e871e
  Zhewen Li authored Nov 05, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  0b8e871e
- [Feature]: Add corrupted request metric to V1 metrics system. (#27306) · e1560178
  Snehlata authored Nov 06, 2025
```
Signed-off-by: atalhens <sneh.lata@nutanix.com>
```
  e1560178
- [Feature] Extend batch invariant torch.compile to B200 (#27856) · faedbb4d
  Paul Zhang authored Nov 05, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
```
  faedbb4d
- [CI]: Add LMCacheConnector Unit Tests (#27852) · 40db1944
  Samuel Shen authored Nov 05, 2025
```
Signed-off-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>
```
  40db1944
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [ROCm][MLA] Support block-size > 1 for AITER MLA backend (#27224) · 6cae1e53
  Pleaplusone authored Nov 05, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
```
  6cae1e53
- [BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546
  Ilya Markov authored Nov 05, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  e50c4546
- Bugfix: Cutlass FP8 FusedMoE bad scaling factors (#27255) · 6b7a8118
  amirkl94 authored Nov 05, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  6b7a8118
- [Hybrid allocator + kv connector] revert connector test changes related to... · 86dca07d
  Kuntai Du authored Nov 05, 2025
```
[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  86dca07d
- [Refactor] Lazy-loaded reasoning_parser (#28092) · e261d37c
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  e261d37c
- [Model, Core] Support Granite Speech & LoRA for STT (#24455) · b7cbc254
  Alex Brooks authored Nov 05, 2025
  
  b7cbc254
- [Bugfix] Fix encoder-only model support for transformers backend (#28021) · 0ff05e37
  Isotr0py authored Nov 05, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0ff05e37
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
04 Nov, 2025 5 commits
- [AsyncScheduling] Don't schedule past request max_tokens (#27922) · 938a8169
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  938a8169
- [PerfFix] Avoid separate thread for MP executor shm spin (#28012) · c9f66da8
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9f66da8
- [model] Add support for openPangu_Ultra_MoE (#27521) · 05cae69f
  yt0428 authored Nov 05, 2025
```
Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  05cae69f
- Support using Int4PreshuffledTensor after loading (#26066) · 03c4c4aa
  Jerry Zhang authored Nov 04, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  03c4c4aa
- Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) · 2ec401bc
  yugong333 authored Nov 04, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2ec401bc