Commits · 6a895197fafa7069be75ff615709b77546bcec30 · OpenDAS / vllm_cscc

05 Mar, 2026 11 commits
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
  Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8c760b6a
- [Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  71963481
- [openai api] log exception in exception handler (1/N) (#31164) · 176c799f
  Ning Xie authored Mar 06, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  176c799f
- [KVConnector] Scheduler: Fix num_computed_tokens after async KV load (#34616) · 612e7729
  Or Ozeri authored Mar 05, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  612e7729
- [CI] Stabilize test_no_args_tool_call and add ROCm-specific server args (#36107) · b03ff6a9
  Andreas Karatzas authored Mar 05, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  b03ff6a9
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- [Chore] Correct MTP models test registry ordering (#36115) · 21eb2c33
  Isotr0py authored Mar 05, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  21eb2c33
- [Bugfix] Fix block_size for hybrid model MTP (#36036) · 57c629e9
  Benjamin Chislett authored Mar 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  57c629e9
- [compile] Fix extra cache save on warm start. (#35921) · dd6dbd93
  Zhengxu Chen authored Mar 04, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  dd6dbd93
- [Model] Add LoRA support for Whisper models (#29856) · 3b23d57c
  daje0601 authored Mar 05, 2026
```
Signed-off-by: daje0601 <englishmt4118@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  3b23d57c
04 Mar, 2026 18 commits

[RL] [Weight Sync] Guard IPC update-info pickle deserialization behind... · f678c3f6

Simon Mo authored Mar 04, 2026


[RL] [Weight Sync] Guard IPC update-info pickle deserialization behind insecure serialization flag (#35928)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>

f678c3f6

[CI] Bump `mypy` version (#34950) · 17dc9c7f
Harry Mellor authored Mar 04, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
17dc9c7f
[torch.compile] Stop lazily compiling (#35472) · 5569f521
Richard Zou authored Mar 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
5569f521
[CI] Add Blackwell AsyncTP correctness test (#35871) · d7166e74
Stefano Castagnetta authored Mar 04, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
d7166e74
[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
bc6be89d

[Feature][CI]: compare `func` & `no_func` outputs in test_functionalization.py (#35481) · fb3e78ab

Bhuminjay Soni authored Mar 04, 2026


Signed-off-by: Bhuminjay <bhuminjaysoni@gmail.com>
Signed-off-by: Bhuminjay Soni <Soni5Happy@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

fb3e78ab

Split generic IO Processor plugins tests from Terratorch specific ones (#35756) · 2f2212e6
Christian Pinto authored Mar 04, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
2f2212e6
[Misc] Add `--attention-backend auto` option (#35738) · 18e01a0a
Nicolò Lucchesi authored Mar 04, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
18e01a0a

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
6aa6ad89
[Bugfix][Model] Fix FP8 k_scale/v_scale not loaded for Qwen3-MoE (#35656) · c8c3935b
Raghavan authored Mar 04, 2026
```
Signed-off-by: raghavan <oneraghavan@gmail.com>
```
c8c3935b

[Bugfix][CPUOffloadingManager] Prevent eviction of already-stored blocks in... · bb6888b8

Ronen Schaffer authored Mar 04, 2026


[Bugfix][CPUOffloadingManager] Prevent eviction of already-stored blocks in LRU/ARC `prepare_store()` (#35846)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>

bb6888b8

[Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
d6e04f4c

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

[Core] Remove busy loop from idle buffer readers (#28053) · 6f0dd938

Joe Runde authored Mar 04, 2026


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

6f0dd938

[Refactor] Clean up processor kwargs extraction (#35872) · e3793961
Cyrus Leung authored Mar 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e3793961

[model] support FireRedASR2 (#35727) · c1d96340

AllenDou authored Mar 04, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c1d96340

[Bugfix] Fix EVS implementation for Qwen3 VL (#33607) · 70c73df6
William Zhang authored Mar 03, 2026
```
Signed-off-by: 2ez4bz <133824995+2ez4bz@users.noreply.github.com>
```
70c73df6

03 Mar, 2026 11 commits

[ROCm][CI] Fix TP size issue for `test_gpt_oss` (#35887) · e7213003
Micah Williamson authored Mar 03, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
e7213003

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

[CI] Temporarily Disable Llama4 MoE Refactor Test (#35870) · 881a6b01
Robert Shaw authored Mar 03, 2026
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
881a6b01
[CI] Bump `num_speculative_tokens` to 3 in nightly DeepSeek tests (#35882) · 8e1fd5ba
Matthew Bonanni authored Mar 03, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
8e1fd5ba

fix: Ensure invalid audio files return 400 error (#34715) · ae88468b

JasonCohere authored Mar 03, 2026


Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

ae88468b

TRTLLM gen-full attn Test Coverage (#34986) · e05cb3b9

ojhaanshika authored Mar 03, 2026


Signed-off-by: Anshika Ojha <anshikao@nvidia.com>
Co-authored-by: Anshika Ojha <anshikao@gb-nvl-059-compute09.nvidia.com>

e05cb3b9

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552) · 28ef9ba3

Lucas Wilkinson authored Mar 03, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

28ef9ba3

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49

TJian authored Mar 03, 2026


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

fb7fdc49

[CI] And PPL test for Qwen3.5. (#35853) · fd4a90f3

wang.yuqi authored Mar 03, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fd4a90f3

add regression test (#35834) · b8401cde
hallerite authored Mar 02, 2026
```
Signed-off-by: hallerite <git@hallerite.com>
```
b8401cde
[ROCm][CI] Fix Assertion Logic For `test_gpt_oss` (#35806) · 8b9e8b74
Micah Williamson authored Mar 02, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
8b9e8b74