Commits · 0be9516ea43df0fcb24bf50021e22768a49d61cf · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "58cde5c026efee42987fbc87681ecbf262f9db2b"

07 Apr, 2026 1 commit
- [ROCm][CI] Fix test repo-root assumptions (#39053) · a435e310
  Andreas Karatzas authored Apr 07, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a435e310
06 Apr, 2026 3 commits
- [NIXL][Mamba][3/N] Heterogeneous TP: 3-read conv state transfer (#37635) · bfdc0a3a
  zhanqiuhu authored Apr 06, 2026
  
  bfdc0a3a
- [Feat][Core] safely abort requests when FSM fails to advance (#38663) · e69a2651
  Walter Beller-Morales authored Apr 06, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  e69a2651
- [Mistral Grammar] Support Grammar Factory (#38150) · fef56c18
  Julien Denize authored Apr 06, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  fef56c18
05 Apr, 2026 2 commits

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997) · 4dd49b06

Greg Pereira authored Apr 05, 2026

Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

4dd49b06

[Bugfix][Spec Decode] Fix extract_hidden_states for VLM models (#38987) · 9a528260
Aaron Batilo authored Apr 05, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
9a528260

03 Apr, 2026 2 commits
- [Bugfix] Fix AWQ models batch invariance issues (#38670) · 46f02e00
  Yusuf Mohammad authored Apr 03, 2026
```
Signed-off-by: yusuf <yusuf@deeplearningmachine.mynet>
Signed-off-by: <>
Co-authored-by: yusuf <yusuf@deeplearningmachine.mynet>
```
  46f02e00
- refactor hard coded device string in test files under tests/v1 and tests/lora (#37566) · 32e0c0bf
  wliao2 authored Apr 02, 2026
```
Signed-off-by: Liao, Wei <wei.liao@intel.com>
```
  32e0c0bf
02 Apr, 2026 2 commits
- [CI] Fix: pass string cache_dtype in test_register_kv_caches (#38836) · 7b743ba9
  zhanqiuhu authored Apr 02, 2026
  
  7b743ba9
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
01 Apr, 2026 5 commits
- [Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242) · cbe7d180
  Chauncey authored Apr 02, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cbe7d180
- [NIXL][BUG] Fix Triton heterogeneous TP (#37940) · dc0428eb
  yzong-rh authored Apr 01, 2026
```
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  dc0428eb
- [Bugfix][MLA] Add logits size budget to sparse indexer prefill chunking (#36178) · eb474549
  Lucas Wilkinson authored Apr 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  eb474549
- Fix priority preemption regression test in scheduler (#37051) · 17b72fd1
  HarshRathva authored Apr 01, 2026
```
Signed-off-by: HarshRathva <harshrathvaai@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  17b72fd1
- [Feat][v1] Simple yet General CPU KV Cache Offloading (#37160) · 91e4521f
  Yifan Qiao authored Mar 31, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
```
  91e4521f
31 Mar, 2026 5 commits

[Refactor] Remove dead code in kv connector and model runner (#38383) · 856589ed
Wentao Ye authored Mar 31, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
856589ed

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 757068dc

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>

757068dc

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

[Bugfix][CI] Skip flaky `test_eagle` test (#38566) · 74303896
Nicolò Lucchesi authored Mar 31, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
74303896
[WIP][CI][Bugfix] Fix `test_run_eagle_dp` (#38584) · 7d654635
Matthew Bonanni authored Mar 31, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
7d654635

30 Mar, 2026 5 commits

[Feat][Spec Decode] DFlash (#36847) · 494636b2
Benjamin Chislett authored Mar 30, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
494636b2

[HMA]Fix corner case when hybrid page_size can not be evenly divided issue... · 3b1dbaad

Chendi.Xue authored Mar 30, 2026


[HMA]Fix corner case when hybrid page_size can not be evenly divided issue (blk_size=64,tp=4) (#37467)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

3b1dbaad

Fix ambiguous num_blocks for hybrid attn mamba (#37236) · 1031c84c

Collin McCarthy authored Mar 30, 2026

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

1031c84c

[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8

Nicolò Lucchesi authored Mar 30, 2026


[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>

cc06b4e8

[ROCm][CI] Enable hybrid chunked prefill test (#38317) · 4f2ed5fd
Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
4f2ed5fd

29 Mar, 2026 1 commit

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9%... · 995dea13

Wentao Ye authored Mar 29, 2026


[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

995dea13

28 Mar, 2026 1 commit
- [Test] Fix flaky race condition in test_abort_final_step (#38414) · 6dad4c57
  yzong-rh authored Mar 28, 2026
```
Signed-off-by: Yifan <yzong@redhat.com>
```
  6dad4c57
27 Mar, 2026 2 commits
- [P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946) · 6287e7fa
  dtc authored Mar 27, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
  6287e7fa
- [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) · 7cc302dd
  Or Ozeri authored Mar 27, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7cc302dd
26 Mar, 2026 2 commits
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- Relocate Encoder CUDA graph manager (#38116) · 144030c8
  Woosuk Kwon authored Mar 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  144030c8
25 Mar, 2026 6 commits

[Misc] Reorganize inputs (#35182) · ba2f0acc
Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ba2f0acc
[Refactor] Rename `WAITING_FOR_FSM` to `WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR` (#38048) · 1bf2ddd0
Wentao Ye authored Mar 25, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1bf2ddd0

[Feature] EPLB Support for GPU Model Runner v2 (#37488) · d7e93e13

Wentao Ye authored Mar 25, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>

d7e93e13

[Feature] Support per-draft-model MoE backend via `--speculative-config` (#37880) · cd764301

Andrii Skliar authored Mar 25, 2026


Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: [Andrii Skliar] <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>

cd764301

[Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d215d1ef

[ROCm] Attention selector reordering (#36702) · 189ddefb

Gregory Shtrasberg authored Mar 25, 2026


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

189ddefb

24 Mar, 2026 3 commits

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend... · e3c6c10c

Ronen Schaffer authored Mar 24, 2026


[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into `cpu/` package (#37874)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>

e3c6c10c

[V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
c59a132f