Commits · 289eb6c5373f74bc643890d6e14445d504c2d62d · OpenDAS / vllm_cscc

09 Nov, 2025 2 commits
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
- [CI] Fix flaky `test_eagle_correctness` test (#28364) · 19d91ece
  Nicolò Lucchesi authored Nov 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  19d91ece
08 Nov, 2025 8 commits

[Bugfix] Fix test fused quant layernorm tests (#27865) · 171133f9

ElizaWszola authored Nov 08, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

171133f9

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

[Bugfix] Spec decode + structured output + spec model max len edge case (#28298) · 47604137
Andy Lo authored Nov 08, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
47604137
`reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d9ab1ad9

[Model] Consolidate Deepseek-MoE implementation with DeepSeek-v2 (#28101) · 934a9c3b

Isotr0py authored Nov 08, 2025


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

934a9c3b

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068) · d0c77920

Xiaohong (Sean) Chen authored Nov 07, 2025

Signed-off-by: Sean Chen <xiaohong_chen1991@hotmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>

d0c77920

remove resolve_op_overloads and use splitting_ops directly (#28081) · b158df28
Boyuan Feng authored Nov 07, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
b158df28
Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
811df41e

07 Nov, 2025 10 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319) · 67a2da89
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67a2da89
- [Core] Rework handling of async scheduling config (#28250) · da786e33
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da786e33
- [Bugfix] Fix and add tests for GptOss reasoning parser (#28000) · 18903216
  Benjamin Chislett authored Nov 07, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  18903216
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
- [Perf] Introduce FlattenLogprobs to store logprobs results to reduce GC overhead (#28171) · ccd98b59
  Jialin Ouyang authored Nov 07, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ccd98b59
- [CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all... · a736e5ff
  Copilot authored Nov 07, 2025
```
[CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all tests in nightly (#28074)
```
  a736e5ff
- Add runai model streamer e2e test for GCS (#28079) · a47d94f1
  Alexis MacAskill authored Nov 06, 2025
```
Signed-off-by: Alexis MacAskill <amacaskill@google.com>
```
  a47d94f1
- [CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (#28247) · e70fbc59
  Alex Brooks authored Nov 06, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Signed-off-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e70fbc59
- [Multimodal][torch.compile] Add compilation config field for turning off ViT/MM compile (#28242) · 4bf56c79
  Lucas Kabela authored Nov 06, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  4bf56c79
06 Nov, 2025 8 commits

Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483) · 59b453ea

Junhong Liu authored Nov 07, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>

59b453ea

Fix failing test for CRadio (#27738) · 827e4237

Eugene Khvedchenya authored Nov 07, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: wang.yuqi <noooop@126.com>

827e4237

[Test] Add non-MoE DP test coverage (#28235) · ca90f503
Matthew Bonanni authored Nov 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
ca90f503
[Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
59a50afa
[V0 deprecation]clean up is_v1_supported_oracle (#28116) · c3ee80a0
wangxiyuan authored Nov 06, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
c3ee80a0
Patch Mistral Tokenizer (#28146) · a404e2c0
Julien Denize authored Nov 06, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
a404e2c0
[CI] Add compile/test_multimodal_compile.py to CI (#28151) · bde50393
gmagogsfm authored Nov 05, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
bde50393

[CI Failure] `nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV` was removed from HF.... · f948ab69

Vadim Gimpelson authored Nov 06, 2025


[CI Failure] `nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV` was removed from HF. Skip it in tests (#28170)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>

f948ab69

05 Nov, 2025 12 commits

[CI/Build] Fix `test_defaults_with_usage_context` in AMD CI (#27926) · 0b8e871e
Zhewen Li authored Nov 05, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
0b8e871e
[Feature]: Add corrupted request metric to V1 metrics system. (#27306) · e1560178
Snehlata authored Nov 06, 2025
```
Signed-off-by: atalhens <sneh.lata@nutanix.com>
```
e1560178
[Feature] Extend batch invariant torch.compile to B200 (#27856) · faedbb4d
Paul Zhang authored Nov 05, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
```
faedbb4d

[CI]: Add LMCacheConnector Unit Tests (#27852) · 40db1944

Samuel Shen authored Nov 05, 2025


Signed-off-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>

40db1944

[Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
3f5a4b64
[ROCm][MLA] Support block-size > 1 for AITER MLA backend (#27224) · 6cae1e53
Pleaplusone authored Nov 05, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
```
6cae1e53

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

Bugfix: Cutlass FP8 FusedMoE bad scaling factors (#27255) · 6b7a8118

amirkl94 authored Nov 05, 2025


Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6b7a8118

[Hybrid allocator + kv connector] revert connector test changes related to... · 86dca07d

Kuntai Du authored Nov 05, 2025


[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

86dca07d

[Refactor] Lazy-loaded reasoning_parser (#28092) · e261d37c
Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
e261d37c
[Model, Core] Support Granite Speech & LoRA for STT (#24455) · b7cbc254
Alex Brooks authored Nov 05, 2025

b7cbc254

[Bugfix] Fix encoder-only model support for transformers backend (#28021) · 0ff05e37

Isotr0py authored Nov 05, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0ff05e37