Commits · e8ee2a78dbc08d398d5e798a149657b8aa821850 · OpenDAS / vllm_cscc

24 Apr, 2026 2 commits
- [Attention] use diff kv backend for mimo v2 flash (#40045) · e8ee2a78
  Jiangyun Zhu authored Apr 24, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  e8ee2a78
- [Core] Avoid seq_lens_cpu GPU->CPU sync (#40654) · fe85a92e
  Nick Hill authored Apr 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  fe85a92e
22 Apr, 2026 4 commits

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

[Model] Add block-local attention and YaRN for local layers to Gemma3 (#39823) · 12367487
philip-essential authored Apr 21, 2026
```
Signed-off-by: Philip Monk <169196560+philip-essential@users.noreply.github.com>
```
12367487

[compile] mla + group fp8 fusion (#38877) · 4506319a

Carl Y authored Apr 21, 2026


Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

4506319a

[MyPy] Enable mypy for `vllm/model_executor/layers/` (#40159) · 3951d3ea
Martin Hickey authored Apr 22, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
3951d3ea

21 Apr, 2026 1 commit
- [Misc] Reduce attention logging levels (#40086) · 18563f20
  Chauncey authored Apr 21, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  18563f20
18 Apr, 2026 1 commit
- [Attention] TurboQuant: remove redundant random signs, add prior art attribution (#40194) · ed0622e3
  Dan Alistarh authored Apr 18, 2026
```
Signed-off-by: Dan Alistarh <d.alistarh@gmail.com>
```
  ed0622e3
17 Apr, 2026 1 commit
- Add nvfp4 support to reshape_and_cache_flash (#37332) · 6b2b7bd0
  sychen52 authored Apr 17, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  6b2b7bd0
15 Apr, 2026 1 commit

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

14 Apr, 2026 1 commit

add warning when FP8 KV cache misses prefill query quantization (#39752) · dc8df110

Albert Cheng authored Apr 14, 2026

Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris02.lyris.clusters.nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

dc8df110

10 Apr, 2026 1 commit
- [compile] Allow strings in custom ops without regressing compilation times (#38123) · f44afef6
  Richard Zou authored Apr 10, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  f44afef6
07 Apr, 2026 1 commit
- [Attention][V0 Deprecation] Deprecate accept output buffer (#39125) · 70406eb1
  Lucas Wilkinson authored Apr 07, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  70406eb1
06 Apr, 2026 1 commit
- [EASY] Drop duplicate KV-cache initialization (#38799) · 94fbb098
  namgyu-youn authored Apr 07, 2026
```
Signed-off-by: namgyu-youn <namgyu.dev@gmail.com>
```
  94fbb098
03 Apr, 2026 1 commit

[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) · 1f5ec288

Carl Y authored Apr 02, 2026

Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

1f5ec288

02 Apr, 2026 1 commit

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378) · 2ce3d0ce

JartX authored Apr 02, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yangyang4991 <yangyang4991@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2ce3d0ce

01 Apr, 2026 1 commit
- [1/N][Cleanup] Standardize on use of `is_quantized_kv_cache` (#38659) · 116f4be4
  Matthew Bonanni authored Apr 01, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  116f4be4
31 Mar, 2026 2 commits
- [fix] Remove trtllm ragged mla prefills (#36540) · 598190aa
  Olya Kozlova authored Mar 31, 2026
```
Signed-off-by: Olya Kozlova <okozlova@nvidia.com>
```
  598190aa
- Fix MLA runs when use_inductor_graph_partition=True (#38631) · 202f147c
  ElizaWszola authored Mar 31, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  202f147c
27 Mar, 2026 1 commit
- enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
  Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  98e7f223
25 Mar, 2026 1 commit
- [XPU] support MLA model on Intel GPU (#37143) · 14771f71
  Kunshang Ji authored Mar 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  14771f71
24 Mar, 2026 1 commit
- [V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c59a132f
23 Mar, 2026 1 commit

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

18 Mar, 2026 2 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
17 Mar, 2026 1 commit
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
16 Mar, 2026 1 commit
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
13 Mar, 2026 1 commit
- [Bugfix] Fix MLA attention crash with AWQ/GPTQ quantized models (#34695) · 6d53efd2
  haosdent authored Mar 14, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  6d53efd2
12 Mar, 2026 3 commits
- [Attention] Use FA4 for MLA prefill (#34732) · f444c05c
  Matthew Bonanni authored Mar 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f444c05c
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [MM][OOT] Support CPU `seq_lens` for OOT MMEncoderAttention kernels (#36605) · f0d3658c
  Shanshan Shen authored Mar 12, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f0d3658c
11 Mar, 2026 1 commit
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
09 Mar, 2026 1 commit
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
07 Mar, 2026 2 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- mla: don't update kv cache on dummy forwards (#36282) · 24a03915
  Itay Alroy authored Mar 07, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  24a03915
05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

04 Mar, 2026 1 commit

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

02 Mar, 2026 1 commit

[Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308

ElizaWszola authored Mar 02, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d9c77308

01 Mar, 2026 1 commit

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

27 Feb, 2026 1 commit

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993