Commits · 62b1bbe470ea820b728cf2b6eee4f5f8b9655a57 · OpenDAS / vllm_cscc

23 Apr, 2026 5 commits

[Spec Decode] Move `SpecDecodeBaseProposer` out of `eagle.py` (#40732) · cde8d247
Matthew Bonanni authored Apr 23, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
cde8d247

[Bugfix] Fix workspace resize leaking reserved GPU memory (#39226) · 7ff65b19

czhu-cohere authored Apr 23, 2026


Signed-off-by: root <conway.zhu@cohere.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

7ff65b19

[DP][Ray] Pin DP control bundle to same node as first GPU bundle (#39167) · e9ba519f

shaharmor98 authored Apr 23, 2026

Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

e9ba519f

[Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware (#40193) · b7a26050

Srreyansh Sethi authored Apr 23, 2026


Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

b7a26050

[TurboQuant] enable FA3/FA4 for prefill paths (#40092) · fe9c3d6c

Julian Huang authored Apr 23, 2026


Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>

fe9c3d6c

22 Apr, 2026 7 commits

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

FlexAttention non-causal support (#40394) · 29f64c5f

Fynn Schmitt-Ulms authored Apr 22, 2026


Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

29f64c5f

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd

[Model] Add block-local attention and YaRN for local layers to Gemma3 (#39823) · 12367487
philip-essential authored Apr 21, 2026
```
Signed-off-by: Philip Monk <169196560+philip-essential@users.noreply.github.com>
```
12367487

[kv_offload+HMA][8/N]: Support multi-group worker transfer (#38453) · aad88f84

Or Ozeri authored Apr 22, 2026


Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

aad88f84

[ROCm] Support non-causal attention in ROCM_ATTN (#40176) · 6d097697
Micah Williamson authored Apr 21, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
6d097697

[compile] mla + group fp8 fusion (#38877) · 4506319a

Carl Y authored Apr 21, 2026


Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

4506319a

21 Apr, 2026 9 commits

[Startup][UX] Enable CUDAGraph memory profiling by default (#38284) · 96a85c57
Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
96a85c57
[Refactor] Remove unused param (#39750) · 1842447c
Wentao Ye authored Apr 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1842447c

[Bugfix] Fix spec decode test failures on Blackwell (SM100+) (#39546) · 9f39b380

Rishi Puri authored Apr 21, 2026


Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

9f39b380

[MRv2]fix: model accuracy regression caused by reusing the stale... · 9a6a66f3

Zijing Liu authored Apr 21, 2026


[MRv2]fix: model accuracy regression caused by reusing the stale last_sampled_tokens and draft_tokens (#39833)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>

9a6a66f3

[Model Runner V2] Multiple prompt logprobs support (#39937) · 66cc3fa5

Wentao Ye authored Apr 21, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

66cc3fa5

[UX] Bump version in CG memory profiling log message (#40465) · ab5666eb
Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
ab5666eb

[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph... · 936e0b79

Shanshan Shen authored Apr 21, 2026


[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph video inference (#40445)
Signed-off-by: shen-shanshan <467638484@qq.com>

936e0b79

feat(multimodal): support externally processed mm_kwargs with cache injection (#39502) · 766cb65d

Kris Hung authored Apr 21, 2026


Signed-off-by: Krish Hung <krishung5@gmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

766cb65d

[Feat] dflash support for ROCm (#39703) · f95c11a8
hangy-amd authored Apr 21, 2026
```
Signed-off-by: Hang Yang <hangy@amd.com>
```
f95c11a8

20 Apr, 2026 6 commits

[Misc][UX] Suppress confusing `num_gpu_blocks` log lines (#40402) · c075702e

Matthew Bonanni authored Apr 20, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

c075702e

[Bug] Fix dcp error message (#40053) · b42e878e
Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
b42e878e

[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3... · 7243e02a

larryli2-amd authored Apr 20, 2026


[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

7243e02a

[EPLB] Add nixl-based eplb communicator (#36276) · 50dd4cb4

Ilya Markov authored Apr 20, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>

50dd4cb4

[kv_offload+HMA][4/N]: Support sliding window lookup (#36645) · f774ba02
Or Ozeri authored Apr 20, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
f774ba02
[XPU] [torch.compile] Skipping CUDA graph memory estimation to avoid startup errors. (#39977) · 4f4713f9
Chaojun Zhang authored Apr 20, 2026
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
4f4713f9

19 Apr, 2026 2 commits
- [ROCm] Fix cu_seqlens_q off-by-one in AITER FA speculative decode path (#39120) · f150107e
  Andrew Barnes authored Apr 19, 2026
```
Signed-off-by: Bortlesboat <bortstheboat@gmail.com>
```
  f150107e
- [KV Offload] Pass request context (#39185) · 4353c9cb
  omerpaz95 authored Apr 19, 2026
```
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
```
  4353c9cb
18 Apr, 2026 1 commit
- [Attention] TurboQuant: remove redundant random signs, add prior art attribution (#40194) · ed0622e3
  Dan Alistarh authored Apr 18, 2026
```
Signed-off-by: Dan Alistarh <d.alistarh@gmail.com>
```
  ed0622e3
17 Apr, 2026 6 commits
- [ROCm] Fix TurboQuant on ROCm: backend routing, flash-attn compat, int64 overflow (#39953) · 6ef1efd5
  aditi-amd authored Apr 17, 2026
```
Signed-off-by: aditi <aditi.rana@amd.com>
```
  6ef1efd5
- skip fp8e4b15 on xpu (#39957) · 251c18d1
  Xinyu Chen authored Apr 18, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  251c18d1
- [Bugfix][Core] Fix stuck chunked pipeline parallelism with async scheduling (#38726) · 747256bb
  Jing Wang authored Apr 18, 2026
```
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  747256bb
- Add nvfp4 support to reshape_and_cache_flash (#37332) · 6b2b7bd0
  sychen52 authored Apr 17, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  6b2b7bd0
- [CPU] Refactor CPU affinity and memory management (#39781) · d02421a7
  Li, Jiang authored Apr 17, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  d02421a7
- [kv_offload]: Fix num CPU blocks for UniformTypeKVCacheSpecs (#39617) · 79a5b632
  Or Ozeri authored Apr 17, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  79a5b632
16 Apr, 2026 4 commits
- [MLA] Optimize mla indexer prepare uniform decode for MTP > 1 (#39458) · bf9a5ddb
  Giancarlo Delfin authored Apr 16, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  bf9a5ddb
- Gate SSU dispatch setup (#40039) · b897f00c
  roikoren755 authored Apr 16, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  b897f00c
- [Bugfix] Fix Ray compiled-DAG SHM channel stalls by detaching zero-copy... · 692db29c
  Nikita Shapovalov authored Apr 16, 2026
```
[Bugfix] Fix Ray compiled-DAG SHM channel stalls by detaching zero-copy `np.ndarray` logprobs buffers (#35736)
Signed-off-by: Nikita Shapovalov <nikita@poolside.ai>
```
  692db29c
- [Model Runner V2][BugFix] fix num_sampled dtype for probabilistic rej… (#39951) · 343f6523
  Giancarlo Delfin authored Apr 15, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  343f6523