Commits · 8f87eb4622cf7516ce34c1f9703fee43fb0101e1 · OpenDAS / vllm_cscc

22 Apr, 2026 1 commit

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

20 Apr, 2026 2 commits

[Misc][UX] Suppress confusing `num_gpu_blocks` log lines (#40402) · c075702e

Matthew Bonanni authored Apr 20, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

c075702e

[EPLB] Add nixl-based eplb communicator (#36276) · 50dd4cb4

Ilya Markov authored Apr 20, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>

50dd4cb4

17 Apr, 2026 1 commit
- [Bugfix][Core] Fix stuck chunked pipeline parallelism with async scheduling (#38726) · 747256bb
  Jing Wang authored Apr 18, 2026
```
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  747256bb
16 Apr, 2026 1 commit
- Gate SSU dispatch setup (#40039) · b897f00c
  roikoren755 authored Apr 16, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  b897f00c
14 Apr, 2026 2 commits
- [Hybrid] Simplify accepted token counting in spec decode for hybrid models (#38372) · 507df79a
  Francesco Fusco authored Apr 15, 2026
  
  507df79a
- [Mamba] Flashinfer selective_state_update (#36162) · ecf5ff7c
  roikoren755 authored Apr 14, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  ecf5ff7c
10 Apr, 2026 4 commits
- [Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend (#32936) · 8f121f78
  zhrrr authored Apr 10, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  8f121f78
- [Model] Implement LoRA support for Qwen3ASRForConditionalGeneration (#37247) · 8d0f908b
  Peter Nguyen authored Apr 10, 2026
```
Signed-off-by: Peter Nguyen <petern0408@gmail.com>
```
  8d0f908b
- [Bugfix] Fix V1 dummy run writing NaN to KV cache null block (#39444) · ad720aef
  Elvir Crnčević authored Apr 10, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com>
```
  ad720aef
- [Perf] Reduce H2D pageable memory copies (#38794) · 49d20346
  jackwang2120 authored Apr 10, 2026
```
Signed-off-by: jackcfwang <jackcfwang@tencent.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  49d20346
09 Apr, 2026 2 commits
- [Perf] Optimize redundant sync for pooling model, 3.7% Throughput Improvement (#39113) · ed2f282b
  Wentao Ye authored Apr 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ed2f282b
- [Bugfix] Fix cpu-offload-gb assertion with non-default block sizes (#36461) · 2f41d6c0
  Ajay Anubolu authored Apr 08, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2f41d6c0
08 Apr, 2026 2 commits
- [torch.compile] Allow usage of Opaque Objects in PyTorch 2.11 (#39286) · ba4a78eb
  Richard Zou authored Apr 09, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba4a78eb
- [Bugfix] Cuda Clean up scales Kvcache fp8/int8_per_token_head (#39224) · 140cbb11
  JartX authored Apr 08, 2026
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  140cbb11
05 Apr, 2026 1 commit

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997) · 4dd49b06

Greg Pereira authored Apr 05, 2026

Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

4dd49b06

03 Apr, 2026 3 commits
- Fix invalid logprobs with MTP enabled and sync scheduling (#38711) · 50cd5674
  danisereb authored Apr 03, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  50cd5674
- [KVConnector] Skip `register_kv_caches` on profiling (#38558) · 97f92c6b
  Nicolò Lucchesi authored Apr 03, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  97f92c6b
- full cudagraph for flex-attn (#36298) · 8b141ed8
  shunting314 authored Apr 02, 2026
```
Signed-off-by: shunting314 <shunting@meta.com>
```
  8b141ed8
01 Apr, 2026 2 commits
- [Core] Simplify multimodal masking (#34246) · 4f6eed3b
  Lukas Geiger authored Apr 01, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4f6eed3b
- [1/N][Cleanup] Standardize on use of `is_quantized_kv_cache` (#38659) · 116f4be4
  Matthew Bonanni authored Apr 01, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  116f4be4
31 Mar, 2026 3 commits

Generative Scoring (#34539) · 2e569756

Vedant V Jhaveri authored Mar 31, 2026


Signed-off-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2e569756

[Refactor] Remove dead code in kv connector and model runner (#38383) · 856589ed
Wentao Ye authored Mar 31, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
856589ed

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 757068dc

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>

757068dc

30 Mar, 2026 4 commits

[Bugfix] Use null block (0) for padded block table entries (#35431) · bcc6f674

SandishKumarHN authored Mar 30, 2026


Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

bcc6f674

[Feat][Spec Decode] DFlash (#36847) · 494636b2
Benjamin Chislett authored Mar 30, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
494636b2

Fix ambiguous num_blocks for hybrid attn mamba (#37236) · 1031c84c

Collin McCarthy authored Mar 30, 2026

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

1031c84c

[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8

Nicolò Lucchesi authored Mar 30, 2026


[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>

cc06b4e8

29 Mar, 2026 2 commits
- [QeRL] Fix online quantized reloading (#38442) · d28d86e8
  Kyle Sayers authored Mar 29, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d28d86e8
- [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9%... · 995dea13
  Wentao Ye authored Mar 29, 2026
```
[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  995dea13
26 Mar, 2026 1 commit

Relocate Encoder CUDA graph manager (#38116) · 144030c8

Woosuk Kwon authored Mar 25, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

144030c8

24 Mar, 2026 3 commits

Fix Mamba state corruption from referencing stale block table entries (#37728) (#37728) (#37728) · c07e2ca6
Ming Yang authored Mar 24, 2026

c07e2ca6

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

[V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
c59a132f

23 Mar, 2026 3 commits

[Async][Spec Decoding] Zero-bubble async scheduling + spec decoding (#32951) · fafe76b4

Matthew Bonanni authored Mar 23, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Co-authored-by: zhrrr <43847754+izhuhaoran@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

fafe76b4

[Bugfix] RoBERTa position_id accumulation in CUDA graph padding region (#37873) · 7151ae65
yanghui1-arch authored Mar 23, 2026
```
Signed-off-by: dass90 <3053034939@qq.com>
```
7151ae65
[Feature] ViT Full CUDA Graph (#35963) · f85e479e
Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
f85e479e

20 Mar, 2026 2 commits
- [Attention] Support distinguishing between short extends and decodes (#37303) · e1d85e5c
  Lucas Wilkinson authored Mar 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e1d85e5c
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
19 Mar, 2026 1 commit
- Support temporal compression for Nemotron-3-VL videos (#36808) · 0b6d5262
  Collin McCarthy authored Mar 19, 2026
```
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
```
  0b6d5262