Commits · 32e0c0bfa210cc6e26bebb967c24aa402919d0cb · OpenDAS / vllm_cscc

"examples/offline_inference/vision_language.py" did not exist on "3f06bae9079ee495a34cfadcd9c1ef2a23636084"

03 Apr, 2026 1 commit
- refactor hard coded device string in test files under tests/v1 and tests/lora (#37566) · 32e0c0bf
  wliao2 authored Apr 02, 2026
```
Signed-off-by: Liao, Wei <wei.liao@intel.com>
```
  32e0c0bf
02 Apr, 2026 2 commits
- [CI] Fix: pass string cache_dtype in test_register_kv_caches (#38836) · 7b743ba9
  zhanqiuhu authored Apr 02, 2026
  
  7b743ba9
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
01 Apr, 2026 5 commits
- [Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242) · cbe7d180
  Chauncey authored Apr 02, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cbe7d180
- [NIXL][BUG] Fix Triton heterogeneous TP (#37940) · dc0428eb
  yzong-rh authored Apr 01, 2026
```
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  dc0428eb
- [Bugfix][MLA] Add logits size budget to sparse indexer prefill chunking (#36178) · eb474549
  Lucas Wilkinson authored Apr 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  eb474549
- Fix priority preemption regression test in scheduler (#37051) · 17b72fd1
  HarshRathva authored Apr 01, 2026
```
Signed-off-by: HarshRathva <harshrathvaai@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  17b72fd1
- [Feat][v1] Simple yet General CPU KV Cache Offloading (#37160) · 91e4521f
  Yifan Qiao authored Mar 31, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
```
  91e4521f
31 Mar, 2026 5 commits

[Refactor] Remove dead code in kv connector and model runner (#38383) · 856589ed
Wentao Ye authored Mar 31, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
856589ed

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 757068dc

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>

757068dc

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

[Bugfix][CI] Skip flaky `test_eagle` test (#38566) · 74303896
Nicolò Lucchesi authored Mar 31, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
74303896
[WIP][CI][Bugfix] Fix `test_run_eagle_dp` (#38584) · 7d654635
Matthew Bonanni authored Mar 31, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
7d654635

30 Mar, 2026 5 commits

[Feat][Spec Decode] DFlash (#36847) · 494636b2
Benjamin Chislett authored Mar 30, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
494636b2

[HMA]Fix corner case when hybrid page_size can not be evenly divided issue... · 3b1dbaad

Chendi.Xue authored Mar 30, 2026


[HMA]Fix corner case when hybrid page_size can not be evenly divided issue (blk_size=64,tp=4) (#37467)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

3b1dbaad

Fix ambiguous num_blocks for hybrid attn mamba (#37236) · 1031c84c

Collin McCarthy authored Mar 30, 2026

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

1031c84c

[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8

Nicolò Lucchesi authored Mar 30, 2026


[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>

cc06b4e8

[ROCm][CI] Enable hybrid chunked prefill test (#38317) · 4f2ed5fd
Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
4f2ed5fd

29 Mar, 2026 1 commit

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9%... · 995dea13

Wentao Ye authored Mar 29, 2026


[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

995dea13

28 Mar, 2026 1 commit
- [Test] Fix flaky race condition in test_abort_final_step (#38414) · 6dad4c57
  yzong-rh authored Mar 28, 2026
```
Signed-off-by: Yifan <yzong@redhat.com>
```
  6dad4c57
27 Mar, 2026 2 commits
- [P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946) · 6287e7fa
  dtc authored Mar 27, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
  6287e7fa
- [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) · 7cc302dd
  Or Ozeri authored Mar 27, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7cc302dd
26 Mar, 2026 2 commits
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- Relocate Encoder CUDA graph manager (#38116) · 144030c8
  Woosuk Kwon authored Mar 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  144030c8
25 Mar, 2026 6 commits

[Misc] Reorganize inputs (#35182) · ba2f0acc
Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ba2f0acc
[Refactor] Rename `WAITING_FOR_FSM` to `WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR` (#38048) · 1bf2ddd0
Wentao Ye authored Mar 25, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1bf2ddd0

[Feature] EPLB Support for GPU Model Runner v2 (#37488) · d7e93e13

Wentao Ye authored Mar 25, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>

d7e93e13

[Feature] Support per-draft-model MoE backend via `--speculative-config` (#37880) · cd764301

Andrii Skliar authored Mar 25, 2026


Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: [Andrii Skliar] <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>

cd764301

[Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d215d1ef

[ROCm] Attention selector reordering (#36702) · 189ddefb

Gregory Shtrasberg authored Mar 25, 2026


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

189ddefb

24 Mar, 2026 3 commits

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend... · e3c6c10c

Ronen Schaffer authored Mar 24, 2026


[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into `cpu/` package (#37874)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>

e3c6c10c

[V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
c59a132f

23 Mar, 2026 4 commits

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

[Async][Spec Decoding] Zero-bubble async scheduling + spec decoding (#32951) · fafe76b4

Matthew Bonanni authored Mar 23, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Co-authored-by: zhrrr <43847754+izhuhaoran@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

fafe76b4

[CI][PD] Add Hybrid SSM integration tests to CI (#37657) · 1cbbcfe8
Nicolò Lucchesi authored Mar 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
1cbbcfe8
[Feature] ViT Full CUDA Graph (#35963) · f85e479e
Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
f85e479e

22 Mar, 2026 2 commits
- [Test] Only Run MLA model when user explicitly set for batch invariance (#37719) · eaf49786
  Wentao Ye authored Mar 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eaf49786
- [Bugfix] Fix pooling non-determinism from pinned prompt_lens aliasing (#37775) · 66f927f2
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  66f927f2
21 Mar, 2026 1 commit

Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884

Brandon Pelfrey authored Mar 21, 2026


Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

80b70884