Commits · 97995f6376fd3dae7a67624055ddf038233e181e · OpenDAS / vllm_cscc · GitLab

03 Mar, 2026 33 commits
- [MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63
  Robert Shaw authored Mar 03, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  97995f63
- [CI] Temporarily Disable Llama4 MoE Refactor Test (#35870) · 881a6b01
  Robert Shaw authored Mar 03, 2026
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  881a6b01
- [CI] Bump `num_speculative_tokens` to 3 in nightly DeepSeek tests (#35882) · 8e1fd5ba
  Matthew Bonanni authored Mar 03, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  8e1fd5ba
- fix: Ensure invalid audio files return 400 error (#34715) · ae88468b
  JasonCohere authored Mar 03, 2026
```
Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  ae88468b
- TRTLLM gen-full attn Test Coverage (#34986) · e05cb3b9
  ojhaanshika authored Mar 03, 2026
```
Signed-off-by: Anshika Ojha <anshikao@nvidia.com>
Co-authored-by: Anshika Ojha <anshikao@gb-nvl-059-compute09.nvidia.com>
```
  e05cb3b9
- [BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552) · 28ef9ba3
  Lucas Wilkinson authored Mar 03, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  28ef9ba3
- [ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49
  TJian authored Mar 03, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  fb7fdc49
- [Frontend][1/n] Improve pooling entrypoints | classify. (#35604) · ea463978
  wang.yuqi authored Mar 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  ea463978
- [Bugfix] Avoid src/dst as None in irecv/isend_tensor_dict (#35754) · 440f0e7d
  Li, Jiang authored Mar 03, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  440f0e7d
- [CI] And PPL test for Qwen3.5. (#35853) · fd4a90f3
  wang.yuqi authored Mar 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  fd4a90f3
- [Perf] [Hybrid] Copy num_accepted_tokens in non-blocking way when not using prefix caching (#35442) · ad9d09e2
  Thomas Parnell authored Mar 03, 2026
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ad9d09e2
- [CI/Build][Intel] Add new performance benchmarks for Intel Gaudi 3 (#31025) · 4beebfd1
  Szymon Reginis authored Mar 03, 2026
```
Signed-off-by: Szymon Reginis <sreginis@habana.ai>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  4beebfd1
- add regression test (#35834) · b8401cde
  hallerite authored Mar 02, 2026
```
Signed-off-by: hallerite <git@hallerite.com>
```
  b8401cde
- [ROCm] [Release] Change the package from `aiter` to `amd-aiter` (#35198) · 5dfc5abe
  TJian authored Mar 03, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  5dfc5abe
- Fix TYPE_CHECKING stub defaults in envs.py to match actual runtime defaults (#35645) · 8fa68a8c
  lin-shh authored Mar 03, 2026
  
  8fa68a8c
- [Misc] Fix typos in comments: explict→explicit, paramaters→parameters (#35648) · 35a6f0bf
  lin-shh authored Mar 03, 2026
  
  35a6f0bf
- [MISC] Removed unused function find_all_indices() from tool_parsers/utils.py (#35683) · 3a6cbf16
  Taneem Ibrahim authored Mar 02, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  3a6cbf16
- [BugFix] Fix cmake based incremental install (wrong vllm install dir) (#35773) · f44d1ddc
  Lucas Wilkinson authored Mar 03, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  f44d1ddc
- [CI/Build] Trigger processor tests on registry update (#35824) · 48a54c1e
  Cyrus Leung authored Mar 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  48a54c1e
- [ROCm][CI] Fix Assertion Logic For `test_gpt_oss` (#35806) · 8b9e8b74
  Micah Williamson authored Mar 02, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  8b9e8b74
- [Refactor] Fix maxsim cuda platform and add cli to control it (#35427) · c21d0039
  Wentao Ye authored Mar 02, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c21d0039
- [CI/Build] Automatically patch video metadata for multimodal processor test (#35822) · 7d8bbe6f
  Isotr0py authored Mar 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7d8bbe6f
- [Core] Add optional flags to check for repetitive token patterns in engine output (#35451) · 25e02647
  aykoppol authored Mar 02, 2026
```
Signed-off-by: aykoppol <aykoppol+git@gmail.com>
```
  25e02647
- [Model Runner V2] Use ModelState.prepare_attn() for cuda graph capture [5/N] (#35774) · a0a5178a
  Woosuk Kwon authored Mar 02, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a0a5178a
- [V0 deprecation] Remove Swin model (#35821) · 8ea8ba27
  Isotr0py authored Mar 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ea8ba27
- [Docs][Model Runner V2] Add Design Docs (#35819) · 4f85bae9
  Woosuk Kwon authored Mar 02, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  4f85bae9
- [ModelRunnerV2] Rename sampler functions and variables for clarity (#35459) · 0a7165fd
  Andy Lo authored Mar 03, 2026
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  0a7165fd
- [CI] Temporarily Disable Nightly Failures (#35770) · 6521ccf2
  Robert Shaw authored Mar 02, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  6521ccf2
- [Tool Parser] Fix Qwen3Coder streaming parameter loss with speculative decode (#35615) · 8ebd872f
  Martin Vit authored Mar 03, 2026
```
Signed-off-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  8ebd872f
- [Model Runner V2][Perf] align dummy_run tokens to uniform decode for dp cudagraph (#35376) · 168ee03e
  zhrrr authored Mar 03, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  168ee03e
- [XPU][NIXL] Add GPUDirect RDMA support for XPU (#35270) · 9dd656f0
  liuzhenwei authored Mar 03, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  9dd656f0
- [Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
  Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  c8b678e5
- [ROCm][CI] Fix backslash-continuation in pytest marker re-quoting and treat... · 18c29c74
  Andreas Karatzas authored Mar 02, 2026
```
[ROCm][CI] Fix backslash-continuation in pytest marker re-quoting and treat exit code 5 as success (#35798)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  18c29c74
02 Mar, 2026 7 commits
- [All Reduce] Change default backend of Flashinfer All Reduce to trtllm (#35793) · 96fc0950
  Hanjie Qiu authored Mar 02, 2026
```
Signed-off-by: hjjq <hanjieq@nvidia.com>
```
  96fc0950
- [Bugfix] Fix MM processor test for Qwen3.5 (#35797) · 1b82b433
  Roger Wang authored Mar 02, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  1b82b433
- [MoE][Perf] Wrap DSV3 QKVAProj GEMM in custom op for torch.compile (#35751) · 9319044e
  Robert Shaw authored Mar 02, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9319044e
- clean unused cudagraph_batch_sizes (#35552) · c42dc402
  Boyuan Feng authored Mar 02, 2026
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c42dc402
- [Bugfix] Fix missing sequence_lengths in qwen3_omni_moe_thinker (#35741) · fa6a6be5
  Ye (Charlotte) Qi authored Mar 02, 2026
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  fa6a6be5
- [BUG] Fix rlhf_async example (#35788) · cad21918
  Aaron Hao authored Mar 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cad21918
- [ci] Add Ray compatibility check informational CI job (#34672) · 53700bf4
  Jeffrey Wang authored Mar 02, 2026
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  53700bf4