Commits · ed2f282bc8cacfbe49a86ab1dbaf7e4471ec6b18 · OpenDAS / vllm_cscc

09 Apr, 2026 3 commits
- [Perf] Optimize redundant sync for pooling model, 3.7% Throughput Improvement (#39113) · ed2f282b
  Wentao Ye authored Apr 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ed2f282b
- [Bugfix] Fix cpu-offload-gb assertion with non-default block sizes (#36461) · 2f41d6c0
  Ajay Anubolu authored Apr 08, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2f41d6c0
- [UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) · eb4205fe
  Michael Goin authored Apr 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  eb4205fe
08 Apr, 2026 3 commits
- [torch.compile] Allow usage of Opaque Objects in PyTorch 2.11 (#39286) · ba4a78eb
  Richard Zou authored Apr 09, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba4a78eb
- [Bugfix] Cuda Clean up scales Kvcache fp8/int8_per_token_head (#39224) · 140cbb11
  JartX authored Apr 08, 2026
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  140cbb11
- [Model Runner V2] Fuse probabilistic rejection sample kernels (#38496) · 5daf6227
  Giancarlo Delfin authored Apr 07, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  5daf6227
07 Apr, 2026 1 commit
- [BugFix][MRV2] Fix cuda event reuse race (#39115) · 62095e82
  Nick Hill authored Apr 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  62095e82
06 Apr, 2026 1 commit
- [MRV2] Fix hanging issue with DeepSeek V3.2 by setting `skip_attn=False` (#39098) · f186cfe7
  Woosuk Kwon authored Apr 06, 2026
```
Signed-off-by: WoosukKwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  f186cfe7
05 Apr, 2026 1 commit

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997) · 4dd49b06

Greg Pereira authored Apr 05, 2026

Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

4dd49b06

04 Apr, 2026 1 commit
- [Bug] Fix workspace manager `_current_workspaces` size (#38853) · cab4064c
  Wentao Ye authored Apr 03, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  cab4064c
03 Apr, 2026 5 commits
- Fix invalid logprobs with MTP enabled and sync scheduling (#38711) · 50cd5674
  danisereb authored Apr 03, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  50cd5674
- [KVConnector] Skip `register_kv_caches` on profiling (#38558) · 97f92c6b
  Nicolò Lucchesi authored Apr 03, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  97f92c6b
- [CPU] Replace OMP initialization (#36487) · abebd932
  Anton Ivanov authored Apr 03, 2026
```
Signed-off-by: Anton Ivanov <anton.ivanov@cambridgegreys.com>
```
  abebd932
- [MRV2][KVConnector] Fix missing build_connector_worker_meta (#38698) · 311c9816
  Yifan Qiao authored Apr 02, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
```
  311c9816
- full cudagraph for flex-attn (#36298) · 8b141ed8
  shunting314 authored Apr 02, 2026
```
Signed-off-by: shunting314 <shunting@meta.com>
```
  8b141ed8
02 Apr, 2026 1 commit
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
01 Apr, 2026 3 commits
- [Feat][Executor] Introduce RayExecutorV2 (#36836) · de5e6c44
  Jeffrey Wang authored Apr 01, 2026
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  de5e6c44
- [Core] Simplify multimodal masking (#34246) · 4f6eed3b
  Lukas Geiger authored Apr 01, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4f6eed3b
- [1/N][Cleanup] Standardize on use of `is_quantized_kv_cache` (#38659) · 116f4be4
  Matthew Bonanni authored Apr 01, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  116f4be4
31 Mar, 2026 4 commits

Generative Scoring (#34539) · 2e569756

Vedant V Jhaveri authored Mar 31, 2026


Signed-off-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2e569756

[Refactor] Remove dead code in kv connector and model runner (#38383) · 856589ed
Wentao Ye authored Mar 31, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
856589ed
[torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
077a9a8e

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 757068dc

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>

757068dc

30 Mar, 2026 5 commits

[Bugfix] Use null block (0) for padded block table entries (#35431) · bcc6f674

SandishKumarHN authored Mar 30, 2026


Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

bcc6f674

[Feat][Spec Decode] DFlash (#36847) · 494636b2
Benjamin Chislett authored Mar 30, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
494636b2
[Bugfix][CPU] Skip set_num_threads after thread binding (#38535) · 6557f493
Li, Jiang authored Mar 30, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
6557f493

Fix ambiguous num_blocks for hybrid attn mamba (#37236) · 1031c84c

Collin McCarthy authored Mar 30, 2026

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

1031c84c

[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8

Nicolò Lucchesi authored Mar 30, 2026


[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>

cc06b4e8

29 Mar, 2026 2 commits
- [QeRL] Fix online quantized reloading (#38442) · d28d86e8
  Kyle Sayers authored Mar 29, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d28d86e8
- [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9%... · 995dea13
  Wentao Ye authored Mar 29, 2026
```
[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  995dea13
27 Mar, 2026 1 commit
- [Model Runner V2] Rebuild attention metadata before eagle decode full… (#38311) · 384e4d5f
  Giancarlo Delfin authored Mar 27, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  384e4d5f
26 Mar, 2026 2 commits
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- Relocate Encoder CUDA graph manager (#38116) · 144030c8
  Woosuk Kwon authored Mar 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  144030c8
25 Mar, 2026 1 commit

[Feature] EPLB Support for GPU Model Runner v2 (#37488) · d7e93e13

Wentao Ye authored Mar 25, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>

d7e93e13

24 Mar, 2026 6 commits
- Make microbatch optimization (DBO) work with general models (#37926) · b73b5b06
  Junhao authored Mar 24, 2026
```
Signed-off-by: Junhao Li <junhao@ubicloud.com>
```
  b73b5b06
- [MRV2] Fix for DS v3.2 (#38030) · 4b53740d
  Woosuk Kwon authored Mar 24, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  4b53740d
- [Model Runner V2][Minor] Simplify PP logic (#38031) · 4e824d1c
  Nick Hill authored Mar 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  4e824d1c
- Fix Mamba state corruption from referencing stale block table entries (#37728) (#37728) (#37728) · c07e2ca6
  Ming Yang authored Mar 24, 2026
  
  c07e2ca6
- [Feature] limit thinking tokens (hard limit) (#20859) · 47318847
  Sungjae Lee authored Mar 25, 2026
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  47318847
- [Bugfix] Add replacement of _compute_slot_mapping_kernel on CPU (#37987) · 352b90c4
  Li, Jiang authored Mar 24, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  352b90c4