Commits · 0fab52f0aa0fa34d96f2aefe507283478caa66d4 · OpenDAS / vllm_cscc

01 Apr, 2026 1 commit
- [Feat][v1] Simple yet General CPU KV Cache Offloading (#37160) · 91e4521f
  Yifan Qiao authored Mar 31, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
```
  91e4521f
31 Mar, 2026 19 commits

Vedant V Jhaveri authored Mar 31, 2026


Signed-off-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2e569756

[Kernel] [Helion] [17/N] Add Helion kernel torch.compile support (#38592) · cc671cb1
Yanan Cao authored Mar 31, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com>
```
cc671cb1
[Refactor] Remove dead code in kv connector and model runner (#38383) · 856589ed
Wentao Ye authored Mar 31, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
856589ed

[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286) · d9b90a07

yzong-rh authored Mar 31, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: yzong-rh <yzong@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d9b90a07

[fix] Remove trtllm ragged mla prefills (#36540) · 598190aa
Olya Kozlova authored Mar 31, 2026
```
Signed-off-by: Olya Kozlova <okozlova@nvidia.com>
```
598190aa
[torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
077a9a8e
[Bugfix] Fix FusedMoE weight loading with padded hidden dimensions (#37010) · 3896e021
SandishKumarHN authored Mar 31, 2026
```
Signed-off-by: SandishKumarHN <sandish@fb.com>
```
3896e021

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 757068dc

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>

757068dc

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

[Bugfix][CI] Skip flaky `test_eagle` test (#38566) · 74303896
Nicolò Lucchesi authored Mar 31, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
74303896
[CI] fix LM Eval Qwen3.5 Models (B200) (#38632) · ea7bfde6
Jiangyun Zhu authored Mar 31, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
ea7bfde6

[EPLB] Add alternative communication for EPLB weight exchange (#33176) · abdbb683

Ilya Markov authored Mar 31, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>

abdbb683

[CI Failure] pin colmodernvbert revision (#38612) · 719735d6

wang.yuqi authored Mar 31, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

719735d6

[WIP][CI][Bugfix] Fix `test_run_eagle_dp` (#38584) · 7d654635
Matthew Bonanni authored Mar 31, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
7d654635
[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631) · d9d21eb8
wang.yuqi authored Mar 31, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
d9d21eb8
[CPU] Support int8 compute mode in CPU AWQ (#35697) · f09daea2
Yintong Lu authored Mar 31, 2026
```
Signed-off-by: Yintong Lu <yintong.lu@intel.com>
```
f09daea2
[OOT] Add OOT support for linear kernel. (#37989) · 1ac66942
zhangyiming authored Mar 31, 2026
```
Signed-off-by: menogrey <1299267905@qq.com>
```
1ac66942
[Tool Parser][2/3] Use self.tools instead of request.tools in tool parsers (#38189) · d53cb9cb
Flora Feng authored Mar 31, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
d53cb9cb
[ROCm][CI] Fix Whisper translation test attention backend selection (#38508) · b9cdc852
Andreas Karatzas authored Mar 31, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
b9cdc852

30 Mar, 2026 19 commits
- [Bugfix] Use null block (0) for padded block table entries (#35431) · bcc6f674
  SandishKumarHN authored Mar 30, 2026
```
Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  bcc6f674
- [ROCm][CI] Pin test_hybrid test to TRITON_ATTN on ROCm (#38381) · d9c7db18
  Micah Williamson authored Mar 30, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  d9c7db18
- [EPLB] Optmize eplb mapping and record in router for prefill (#36261) · 12701e8a
  Ilya Markov authored Mar 30, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  12701e8a
- [Feat][Spec Decode] DFlash (#36847) · 494636b2
  Benjamin Chislett authored Mar 30, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  494636b2
- [HMA]Fix corner case when hybrid page_size can not be evenly divided issue... · 3b1dbaad
  Chendi.Xue authored Mar 30, 2026
```
[HMA]Fix corner case when hybrid page_size can not be evenly divided issue (blk_size=64,tp=4) (#37467)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  3b1dbaad
- [NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) · b4a2f3ac
  Johnny authored Mar 30, 2026
```
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
```
  b4a2f3ac
- [Mamba] Add stochastic rounding support (#35753) · 8e6293e8
  roikoren755 authored Mar 30, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  8e6293e8
- [ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698) · dbdd9ae0
  Hongxia Yang authored Mar 30, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  dbdd9ae0
- [Bugfix] Handle ParallelLMHead in compressed-tensors get_quant_method (#37291) · e8b055a5
  Matthias Gehre authored Mar 30, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e8b055a5
- [Core][CI] Add opt-in media URL caching via VLLM_MEDIA_CACHE (#37123) · 677424c7
  Andreas Karatzas authored Mar 30, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  677424c7
- Fix ambiguous num_blocks for hybrid attn mamba (#37236) · 1031c84c
  Collin McCarthy authored Mar 30, 2026
```
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  1031c84c
- [Bugfix][Frontend] Return 400 for corrupt/truncated image inputs instead of 500 (#38253) · 7e76af14
  aliialsaeedii authored Mar 30, 2026
```
Signed-off-by: aliialsaeedii <ali.al-saeedi@nscale.com>
```
  7e76af14
- [Bugfix] Fix shared-object aliasing in n>1 streaming with tool calls (#38158) · 3683fe6c
  yzong-rh authored Mar 30, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  3683fe6c
- [Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8
  Nicolò Lucchesi authored Mar 30, 2026
```
[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  cc06b4e8
- [CI] Fix SPLADE pooler test broken by #38139 (#38495) · a08b7733
  haosdent authored Mar 30, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a08b7733
- (security) Fix SSRF in batch runner download_bytes_from_url (#38482) · 57861ae4
  Juan Pérez de Algaba authored Mar 30, 2026
```
Signed-off-by: jperezde <jperezde@redhat.com>
```
  57861ae4
- [CI] Add temperature=0.0, reduce max_tokens, and add debug prints to audio_in_video tests (#38492) · bea23536
  Andreas Karatzas authored Mar 30, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bea23536
- [Bugfix] Support multi-type params parsing for DeepSeek v3.2 (#33703) · a6db99ba
  Stanislav Kirillov authored Mar 30, 2026
```
Signed-off-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  a6db99ba
- [ROCm][CI] Enable hybrid chunked prefill test (#38317) · 4f2ed5fd
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f2ed5fd
29 Mar, 2026 1 commit
- [QeRL] Fix online quantized reloading (#38442) · d28d86e8
  Kyle Sayers authored Mar 29, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d28d86e8