Commits · 4f6eed3bd4a92c6bd513460ee85b917d6df88a17 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "8d6cd32b7b4b80207ba210d9e805d07f00bfde07"

01 Apr, 2026 8 commits

[Core] Simplify multimodal masking (#34246) · 4f6eed3b
Lukas Geiger authored Apr 01, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
4f6eed3b
[CPU] Support head_size 512 in cpu_attn (#38676) · 36d7f198
Li, Jiang authored Apr 01, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
36d7f198

[bugfix] do not add extra linebreak for score/rerank with chat template (#38617) · ef53395e

Augusto Yao authored Apr 01, 2026


Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ef53395e

[Bugfix][MLA] Add logits size budget to sparse indexer prefill chunking (#36178) · eb474549
Lucas Wilkinson authored Apr 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
eb474549
Fix priority preemption regression test in scheduler (#37051) · 17b72fd1
HarshRathva authored Apr 01, 2026
```
Signed-off-by: HarshRathva <harshrathvaai@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
17b72fd1
[Misc] Add 20 regression tests for 11 tool parser bug fixes (#38172) · cb0b4432
Ben Browning authored Mar 31, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
cb0b4432

[vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825) · 40bb1750

Luka Govedič authored Mar 31, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>

40bb1750

[Feat][v1] Simple yet General CPU KV Cache Offloading (#37160) · 91e4521f
Yifan Qiao authored Mar 31, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
```
91e4521f

31 Mar, 2026 19 commits

Generative Scoring (#34539) · 2e569756

Vedant V Jhaveri authored Mar 31, 2026


Signed-off-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2e569756

[Kernel] [Helion] [17/N] Add Helion kernel torch.compile support (#38592) · cc671cb1
Yanan Cao authored Mar 31, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com>
```
cc671cb1
[Refactor] Remove dead code in kv connector and model runner (#38383) · 856589ed
Wentao Ye authored Mar 31, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
856589ed

[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286) · d9b90a07

yzong-rh authored Mar 31, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: yzong-rh <yzong@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d9b90a07

[fix] Remove trtllm ragged mla prefills (#36540) · 598190aa
Olya Kozlova authored Mar 31, 2026
```
Signed-off-by: Olya Kozlova <okozlova@nvidia.com>
```
598190aa
[torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
077a9a8e
[Bugfix] Fix FusedMoE weight loading with padded hidden dimensions (#37010) · 3896e021
SandishKumarHN authored Mar 31, 2026
```
Signed-off-by: SandishKumarHN <sandish@fb.com>
```
3896e021

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 757068dc

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>

757068dc

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

[Bugfix][CI] Skip flaky `test_eagle` test (#38566) · 74303896
Nicolò Lucchesi authored Mar 31, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
74303896
[CI] fix LM Eval Qwen3.5 Models (B200) (#38632) · ea7bfde6
Jiangyun Zhu authored Mar 31, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
ea7bfde6

[EPLB] Add alternative communication for EPLB weight exchange (#33176) · abdbb683

Ilya Markov authored Mar 31, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>

abdbb683

[CI Failure] pin colmodernvbert revision (#38612) · 719735d6

wang.yuqi authored Mar 31, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

719735d6

[WIP][CI][Bugfix] Fix `test_run_eagle_dp` (#38584) · 7d654635
Matthew Bonanni authored Mar 31, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
7d654635
[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631) · d9d21eb8
wang.yuqi authored Mar 31, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
d9d21eb8
[CPU] Support int8 compute mode in CPU AWQ (#35697) · f09daea2
Yintong Lu authored Mar 31, 2026
```
Signed-off-by: Yintong Lu <yintong.lu@intel.com>
```
f09daea2
[OOT] Add OOT support for linear kernel. (#37989) · 1ac66942
zhangyiming authored Mar 31, 2026
```
Signed-off-by: menogrey <1299267905@qq.com>
```
1ac66942
[Tool Parser][2/3] Use self.tools instead of request.tools in tool parsers (#38189) · d53cb9cb
Flora Feng authored Mar 31, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
d53cb9cb
[ROCm][CI] Fix Whisper translation test attention backend selection (#38508) · b9cdc852
Andreas Karatzas authored Mar 31, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
b9cdc852

30 Mar, 2026 13 commits

[Bugfix] Use null block (0) for padded block table entries (#35431) · bcc6f674

SandishKumarHN authored Mar 30, 2026


Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

bcc6f674

[ROCm][CI] Pin test_hybrid test to TRITON_ATTN on ROCm (#38381) · d9c7db18
Micah Williamson authored Mar 30, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
d9c7db18
[EPLB] Optmize eplb mapping and record in router for prefill (#36261) · 12701e8a
Ilya Markov authored Mar 30, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
12701e8a
[Feat][Spec Decode] DFlash (#36847) · 494636b2
Benjamin Chislett authored Mar 30, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
494636b2

[HMA]Fix corner case when hybrid page_size can not be evenly divided issue... · 3b1dbaad

Chendi.Xue authored Mar 30, 2026


[HMA]Fix corner case when hybrid page_size can not be evenly divided issue (blk_size=64,tp=4) (#37467)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

3b1dbaad

[NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) · b4a2f3ac

Johnny authored Mar 30, 2026


Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>

b4a2f3ac

[Mamba] Add stochastic rounding support (#35753) · 8e6293e8
roikoren755 authored Mar 30, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
8e6293e8
[ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698) · dbdd9ae0
Hongxia Yang authored Mar 30, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
dbdd9ae0
[Bugfix] Handle ParallelLMHead in compressed-tensors get_quant_method (#37291) · e8b055a5
Matthias Gehre authored Mar 30, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
e8b055a5
[Core][CI] Add opt-in media URL caching via VLLM_MEDIA_CACHE (#37123) · 677424c7
Andreas Karatzas authored Mar 30, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
677424c7

Fix ambiguous num_blocks for hybrid attn mamba (#37236) · 1031c84c

Collin McCarthy authored Mar 30, 2026

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

1031c84c

[Bugfix][Frontend] Return 400 for corrupt/truncated image inputs instead of 500 (#38253) · 7e76af14
aliialsaeedii authored Mar 30, 2026
```
Signed-off-by: aliialsaeedii <ali.al-saeedi@nscale.com>
```
7e76af14

[Bugfix] Fix shared-object aliasing in n>1 streaming with tool calls (#38158) · 3683fe6c

yzong-rh authored Mar 30, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

3683fe6c