Commits · 98e7f223b9fb03537adc856e594a34a3cd018536 · OpenDAS / vllm_cscc

27 Mar, 2026 1 commit
- enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
  Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  98e7f223
25 Mar, 2026 1 commit
- [XPU] support MLA model on Intel GPU (#37143) · 14771f71
  Kunshang Ji authored Mar 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  14771f71
24 Mar, 2026 1 commit
- [V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c59a132f
23 Mar, 2026 1 commit

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

18 Mar, 2026 2 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
17 Mar, 2026 1 commit
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
16 Mar, 2026 1 commit
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
13 Mar, 2026 1 commit
- [Bugfix] Fix MLA attention crash with AWQ/GPTQ quantized models (#34695) · 6d53efd2
  haosdent authored Mar 14, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  6d53efd2
12 Mar, 2026 3 commits
- [Attention] Use FA4 for MLA prefill (#34732) · f444c05c
  Matthew Bonanni authored Mar 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f444c05c
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [MM][OOT] Support CPU `seq_lens` for OOT MMEncoderAttention kernels (#36605) · f0d3658c
  Shanshan Shen authored Mar 12, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f0d3658c
11 Mar, 2026 1 commit
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
09 Mar, 2026 1 commit
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
07 Mar, 2026 2 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- mla: don't update kv cache on dummy forwards (#36282) · 24a03915
  Itay Alroy authored Mar 07, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  24a03915
05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

04 Mar, 2026 1 commit

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

02 Mar, 2026 1 commit

[Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308

ElizaWszola authored Mar 02, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d9c77308

01 Mar, 2026 1 commit

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

27 Feb, 2026 1 commit

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

24 Feb, 2026 2 commits

[Attn,KV-cache] Use per-head scales in the attention selector (#34281) · a87cc508

Eldar Kurtić authored Feb 24, 2026


Signed-off-by: Your Name <you@example.com>
Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Your Name <you@example.com>

a87cc508

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

23 Feb, 2026 1 commit
- [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) · b1b5e045
  Yan Ma authored Feb 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b1b5e045
22 Feb, 2026 1 commit
- [Model Bash][DSR1] Add selective dynamic shape marking for CustomOp (#34900) · 74d90b1c
  Vadim Gimpelson authored Feb 22, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  74d90b1c
20 Feb, 2026 1 commit
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
19 Feb, 2026 1 commit

[Bugfix] Fix Basic Models Test (#34818) · 662205d3

Matthew Bonanni authored Feb 19, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

662205d3

15 Feb, 2026 1 commit
- [MM Encoder] Add Triton ViT attention backend (#32183) · 71cd8926
  Isotr0py authored Feb 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  71cd8926
12 Feb, 2026 1 commit

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

10 Feb, 2026 1 commit
- [SM100] Resubmit FMHA FP8 prefill for MLA (#31195) · 578977bb
  Pavani Majety authored Feb 10, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  578977bb
07 Feb, 2026 1 commit
- move checks out of `unified_kv_cache_update` custom op (#33943) · de3869bb
  Rohan Potdar authored Feb 07, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  de3869bb
06 Feb, 2026 1 commit
- fix(ROCm): Make flash_attn import optional in MLA attention (#33511) · 20d7454c
  Rabi Mishra authored Feb 06, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  20d7454c
05 Feb, 2026 3 commits
- [Bugfix] Fix DSV3.2 NVFP4 (#33932) · 4145e50d
  Matthew Bonanni authored Feb 05, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4145e50d
- [perf] Integrate flashinfer concat_mla_k (#31171) · 59a5cb38
  jiahanc authored Feb 05, 2026
  
  59a5cb38
- [Bugfix] fix DeepSeek R1 with CUTLASS MLA Broken on B200 (#33637) · a7be77be
  Chauncey authored Feb 05, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a7be77be
04 Feb, 2026 1 commit
- Implement zero-copy GQA for multimodal and CPU (#33732) · 6e98f6d8
  Taeksang Kim authored Feb 05, 2026
```
Signed-off-by: Taeksang Kim <ts.kim@hyperaccel.ai>
```
  6e98f6d8
03 Feb, 2026 1 commit
- [Bugfix] Fix sparse MLA metadata building (#33579) · bd8da29a
  Matthew Bonanni authored Feb 03, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  bd8da29a
31 Jan, 2026 1 commit
- [Attention] Move MLA `forward` from backend to layer (#33284) · aaa901ad
  Matthew Bonanni authored Jan 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aaa901ad
27 Jan, 2026 2 commits
- [Attention] Use `has_flashinfer` helper (#33177) · 1cbccb6d
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  1cbccb6d
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6