Commits · bc6be89d16c6a0b3763a3fdc2623b90a9f7da8f1 · OpenDAS / vllm_cscc

04 Mar, 2026 14 commits

[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
bc6be89d

[Feature][CI]: compare `func` & `no_func` outputs in test_functionalization.py (#35481) · fb3e78ab

Bhuminjay Soni authored Mar 04, 2026


Signed-off-by: Bhuminjay <bhuminjaysoni@gmail.com>
Signed-off-by: Bhuminjay Soni <Soni5Happy@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

fb3e78ab

Split generic IO Processor plugins tests from Terratorch specific ones (#35756) · 2f2212e6
Christian Pinto authored Mar 04, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
2f2212e6
[Misc] Add `--attention-backend auto` option (#35738) · 18e01a0a
Nicolò Lucchesi authored Mar 04, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
18e01a0a

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
6aa6ad89
[Bugfix][Model] Fix FP8 k_scale/v_scale not loaded for Qwen3-MoE (#35656) · c8c3935b
Raghavan authored Mar 04, 2026
```
Signed-off-by: raghavan <oneraghavan@gmail.com>
```
c8c3935b

[Bugfix][CPUOffloadingManager] Prevent eviction of already-stored blocks in... · bb6888b8

Ronen Schaffer authored Mar 04, 2026


[Bugfix][CPUOffloadingManager] Prevent eviction of already-stored blocks in LRU/ARC `prepare_store()` (#35846)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>

bb6888b8

[Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
d6e04f4c

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

[Core] Remove busy loop from idle buffer readers (#28053) · 6f0dd938

Joe Runde authored Mar 04, 2026


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

6f0dd938

[Refactor] Clean up processor kwargs extraction (#35872) · e3793961
Cyrus Leung authored Mar 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e3793961

[model] support FireRedASR2 (#35727) · c1d96340

AllenDou authored Mar 04, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c1d96340

[Bugfix] Fix EVS implementation for Qwen3 VL (#33607) · 70c73df6
William Zhang authored Mar 03, 2026
```
Signed-off-by: 2ez4bz <133824995+2ez4bz@users.noreply.github.com>
```
70c73df6

03 Mar, 2026 15 commits

[ROCm][CI] Fix TP size issue for `test_gpt_oss` (#35887) · e7213003
Micah Williamson authored Mar 03, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
e7213003

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

[CI] Temporarily Disable Llama4 MoE Refactor Test (#35870) · 881a6b01
Robert Shaw authored Mar 03, 2026
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
881a6b01
[CI] Bump `num_speculative_tokens` to 3 in nightly DeepSeek tests (#35882) · 8e1fd5ba
Matthew Bonanni authored Mar 03, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
8e1fd5ba

fix: Ensure invalid audio files return 400 error (#34715) · ae88468b

JasonCohere authored Mar 03, 2026


Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

ae88468b

TRTLLM gen-full attn Test Coverage (#34986) · e05cb3b9

ojhaanshika authored Mar 03, 2026


Signed-off-by: Anshika Ojha <anshikao@nvidia.com>
Co-authored-by: Anshika Ojha <anshikao@gb-nvl-059-compute09.nvidia.com>

e05cb3b9

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552) · 28ef9ba3

Lucas Wilkinson authored Mar 03, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

28ef9ba3

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49

TJian authored Mar 03, 2026


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

fb7fdc49

[CI] And PPL test for Qwen3.5. (#35853) · fd4a90f3

wang.yuqi authored Mar 03, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fd4a90f3

add regression test (#35834) · b8401cde
hallerite authored Mar 02, 2026
```
Signed-off-by: hallerite <git@hallerite.com>
```
b8401cde
[ROCm][CI] Fix Assertion Logic For `test_gpt_oss` (#35806) · 8b9e8b74
Micah Williamson authored Mar 02, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
8b9e8b74
[CI/Build] Automatically patch video metadata for multimodal processor test (#35822) · 7d8bbe6f
Isotr0py authored Mar 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
7d8bbe6f
[Core] Add optional flags to check for repetitive token patterns in engine output (#35451) · 25e02647
aykoppol authored Mar 02, 2026
```
Signed-off-by: aykoppol <aykoppol+git@gmail.com>
```
25e02647

[CI] Temporarily Disable Nightly Failures (#35770) · 6521ccf2

Robert Shaw authored Mar 02, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

6521ccf2

[Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
c8b678e5

02 Mar, 2026 11 commits
- [Bugfix] Fix MM processor test for Qwen3.5 (#35797) · 1b82b433
  Roger Wang authored Mar 02, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  1b82b433
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
- [torch.compile] Improve cold and warm start compile tests (#35709) · d1a6e96d
  Richard Zou authored Mar 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d1a6e96d
- [CI/Build] Enable Qwen3.5 tests on CI (#35763) · cc0d565f
  Isotr0py authored Mar 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc0d565f
- [Core] Move test utility to test file (#35672) · 4034c3d3
  Turner Jabbour authored Mar 02, 2026
```
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
```
  4034c3d3
- [Fix Bug]`num_active_loras` always equals to zero (#34119) · ada4f4fa
  Runkai Tao authored Mar 02, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ada4f4fa
- [CI] Defining extended V1 e2e + engine tests (#35580) · ec27b36b
  Andreas Karatzas authored Mar 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ec27b36b
- [Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a
  EdalatiAli authored Mar 02, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  cb21972a
- [ROCm][CI] Disable skinny GEMMs in language model standard tests to fix non-determinism (#35152) · c34963f1
  Andreas Karatzas authored Mar 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c34963f1
- [ROCm] add amd-quark package in requirements for rocm to use quantized models (#35658) · f26650d6
  Hongxia Yang authored Mar 02, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  f26650d6
- Fix deprecated v1 config tests (#35327) · a60985b0
  Jesse Cai authored Mar 01, 2026
```
Signed-off-by: Jesse Cai <jessecai@fb.com>
```
  a60985b0