Commits · b7d59ffce2f951e0ec8d1dc3a2f1e3d27f779906 · OpenDAS / vllm_cscc

04 Mar, 2026 40 commits

[UX] Remove NoOpOffloader log (#35678) · b7d59ffc

Robert Shaw authored Mar 04, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

b7d59ffc

[torch.compile] Stop lazily compiling (#35472) · 5569f521
Richard Zou authored Mar 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
5569f521

[Docs] Clarify structured outputs configuration for Qwen3 reasoning mode (#32441) · 138d891d

Davina Zaman authored Mar 04, 2026

Signed-off-by: Davina Zaman <davzaman@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138d891d

[CI] Add Blackwell AsyncTP correctness test (#35871) · d7166e74
Stefano Castagnetta authored Mar 04, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
d7166e74
[Model Runner V2] Fix pooling (#36019) · 417fd28f
Nick Hill authored Mar 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
417fd28f
[Kernel][Mamba] Optimize Mamba2 SSD prefill Triton kernels (#35397) · 7faba503
tomeras91 authored Mar 04, 2026
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
7faba503
[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
bc6be89d

docs: update CPU Docker images to reference Docker Hub instead of AWS ECR (#34882) · 32224f56

Maxime Grenu authored Mar 04, 2026

Signed-off-by: Maxime Grenu <69890511+cluster2600@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

32224f56

docs: add version requirement note for --profiler-config flag (#32454) · f3dc292e
Abhishek Mathukiya authored Mar 04, 2026
```
Signed-off-by: abhishkh <mathukiya.a@northeastern.edu>
```
f3dc292e

[Docs] Add RunPod GPU deployment guide for vLLM (#34531) · 138c5fa1

Chen authored Mar 04, 2026

Signed-off-by: lisperz <zhuchen200245@163.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138c5fa1

[Docs] Upgrade dynamic LoRA warning to admonition block (#35218) · 2f2c1d73
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
2f2c1d73

[Feature][CI]: compare `func` & `no_func` outputs in test_functionalization.py (#35481) · fb3e78ab

Bhuminjay Soni authored Mar 04, 2026


Signed-off-by: Bhuminjay <bhuminjaysoni@gmail.com>
Signed-off-by: Bhuminjay Soni <Soni5Happy@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

fb3e78ab

[Docs] Update design/multiprocessing.md (#30677) · fd3bfe74
Michael Yao authored Mar 05, 2026
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
fd3bfe74
fix minicpmo4.5: fix attn_mask in vit attn && fix resampler pos_emb i… (#34127) · bfdb512f
tc-mb authored Mar 05, 2026
```
Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Co-authored-by: hezhihui <hezhihui@modelbest.cn>
```
bfdb512f
docs(cpu): Clarify pre-built wheels requirement for CPU Python-only build (#35090) · d25c1ec3
Sage authored Mar 04, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
d25c1ec3
[Doc] Add MTP docs and update speculative decoding guidance (#35197) · 7cc6058a
Xing Liu authored Mar 05, 2026
```
Signed-off-by: liuxing <945764858@qq.com>
```
7cc6058a
fix(docs): use static rdzv backend in multi-node troubleshooting script (#34784) · 28028dff
Manrique Vargas authored Mar 04, 2026
```
Signed-off-by: machov <mv1742@nyu.edu>
```
28028dff
docs: add README for logits_processor examples (#35933) · 3417ba56
Dr Alex Mitre authored Mar 04, 2026

3417ba56
Fix phi4-mm and remove cuda binding (#35964) · 58cfe0dc
Yan Ma authored Mar 05, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
58cfe0dc

[Doc] Fix GPU Worker count in Process Count Summary (#36000) · e86221de

simone-dotolo authored Mar 04, 2026

Signed-off-by: simone-dotolo <simonedotolo@libero.it>
Signed-off-by: simone-dotolo <84937474+simone-dotolo@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e86221de

Use MMEncoderAttention (=use FlashAttention) instead of torch.sdpa in radio.py (#35653) · 289fc48a
Netanel Haber authored Mar 04, 2026

289fc48a
Split generic IO Processor plugins tests from Terratorch specific ones (#35756) · 2f2212e6
Christian Pinto authored Mar 04, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
2f2212e6
[Misc] Add `--attention-backend auto` option (#35738) · 18e01a0a
Nicolò Lucchesi authored Mar 04, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
18e01a0a

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

[Bugfix] Make `kaldi_native_fbank` optional (#35996) · ead7bde1
Cyrus Leung authored Mar 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ead7bde1
[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
6aa6ad89
[Bugfix][Model] Fix FP8 k_scale/v_scale not loaded for Qwen3-MoE (#35656) · c8c3935b
Raghavan authored Mar 04, 2026
```
Signed-off-by: raghavan <oneraghavan@gmail.com>
```
c8c3935b

[Bugfix][CPUOffloadingManager] Prevent eviction of already-stored blocks in... · bb6888b8

Ronen Schaffer authored Mar 04, 2026


[Bugfix][CPUOffloadingManager] Prevent eviction of already-stored blocks in LRU/ARC `prepare_store()` (#35846)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>

bb6888b8

[MISC] fixed tool_parser mypy errors (#35640) · 1aaec59d

Taneem Ibrahim authored Mar 04, 2026

Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1aaec59d

[Feature] Add basic metrics for /realtime endpoint (#35500) · 1659b2e0

pougetat authored Mar 04, 2026

Signed-off-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Signed-off-by: pougetat <thomas.pougetabadie@gmail.com>
Co-authored-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1659b2e0

[Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
d6e04f4c
[XPU] bump vllm-xpu-kernels to v0.1.3 (#35984) · a8f66cbd
Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
a8f66cbd

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

[ROCm][Bugfix] Fall back from CK MXFP4 MoE when GEMM dimensions are unsupported (#35893) · 5dc35387
Chuan (Richard) Li authored Mar 04, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
5dc35387

[Bugfix] Add missing dynamic_arg_dims for Qwen3-ASR torch.compile (#35869) · 36bf2131

Nathan Price authored Mar 04, 2026


Signed-off-by: Nathan Price <nathan@abridge.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

36bf2131

[Core] Remove busy loop from idle buffer readers (#28053) · 6f0dd938

Joe Runde authored Mar 04, 2026


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

6f0dd938

Support Audio Extraction from MP4 Video for Nemotron Nano VL (#35539) · 5d199ac8

Andrii Skliar authored Mar 04, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Andrii <askliar@nvidia.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Andrii Skliar <askliar@oci-nrt-cs-001-vscode-01.cm.cluster>
Co-authored-by: Andrii <askliar@nvidia.com>
Co-authored-by: root <root@pool0-03748.cm.cluster>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: root <root@pool0-02416.cm.cluster>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: root <root@pool0-04880.cm.cluster>

5d199ac8

[cohere][fix][spec-decode]: fix crash when allowed_token_ids is set without penalties (#35654) · 9e0f44be
Komal Kumar Teru authored Mar 04, 2026
```
Signed-off-by: kkt-cohere <komal@cohere.com>
```
9e0f44be
[Bugfix] Improve engine ready timeout error message (#35616) · 097eb544
lailoo authored Mar 04, 2026
```
Signed-off-by: damaozi <1811866786@qq.com>
```
097eb544
[BugFix] Support tool_choice=none in the Anthropic API (#35835) · 7cdba98e
ShiJie Zhong authored Mar 04, 2026
```
Signed-off-by: ZhongsJie <zhongsjie@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
7cdba98e