Commits · a6be75dbd2a8dd1886da725727ee178f42e3f84f · OpenDAS / vllm_cscc

06 Mar, 2026 2 commits
- [ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear) (#35850) · c188749b
  Chuan (Richard) Li authored Mar 06, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
  c188749b
- Reenable features for ROCm attention backends (#36185) · c5362c73
  Rohan Potdar authored Mar 05, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  c5362c73
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
8c760b6a

03 Mar, 2026 1 commit

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552) · 28ef9ba3

Lucas Wilkinson authored Mar 03, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

28ef9ba3

28 Feb, 2026 1 commit
- [Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) · 7e08c22b
  Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  7e08c22b
25 Feb, 2026 1 commit
- [Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  8ad54a99
24 Feb, 2026 1 commit
- [Bug][DSV3.2] Always prepare metadata for DeepGEMM Sparse Attention (#35075) · 9fa5b25a
  Benjamin Chislett authored Feb 24, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  9fa5b25a
17 Feb, 2026 1 commit
- [Bugfix][MTP][Sparse MLA] Allow sparse MLA with MTP to run with FULL cudagraphs (#34457) · dc5fa77a
  Matthew Bonanni authored Feb 17, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dc5fa77a
12 Feb, 2026 1 commit

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

11 Feb, 2026 1 commit
- Reapply [Attention][FA3] Update FA3 to include new swizzle optimization (#34043) · c7914d30
  Lucas Wilkinson authored Feb 11, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  c7914d30
10 Feb, 2026 1 commit

[Perf][Kernel] Add faster topKperRow decode kernel for DeepSeek-V3.2 sparse attention (#33680) · afdce12c

Roberto L. Castro authored Feb 10, 2026

Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>

afdce12c

05 Feb, 2026 1 commit
- Revert "[Attention][FA3] Update FA3 to include new swizzle optimization" (#33841) · e3bf79ff
  Luka Govedič authored Feb 04, 2026
  
  e3bf79ff
03 Feb, 2026 1 commit
- [Attention][FA3] Update FA3 to include new swizzle optimization (#23465) · 2267cb1c
  Lucas Wilkinson authored Feb 03, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  2267cb1c
31 Jan, 2026 2 commits
- [Attention] Clarify comment explaining attn_logits +1 dimension (#33427) · 5b55c0be
  Francesco Fusco authored Jan 31, 2026
```
Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>
```
  5b55c0be
- [Attention] Move MLA `forward` from backend to layer (#33284) · aaa901ad
  Matthew Bonanni authored Jan 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aaa901ad
30 Jan, 2026 1 commit

[Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db

杨朱 · Kiki authored Jan 30, 2026


Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

1a7894db

28 Jan, 2026 1 commit
- Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb673a0
23 Jan, 2026 3 commits

fix: Add glm4_moe_lite to MLA detection (#32614) · 586a57ad

Markus / Mark authored Jan 23, 2026


Signed-off-by: marksverdhei <marksverdhei@hotmail.com>
Signed-off-by: Markus / Mark <46672778+marksverdhei@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

586a57ad

[Misc] Add `get_name` to missing AttentionBackends (#32698) · 160c6fa3
Nicolò Lucchesi authored Jan 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
160c6fa3
[CI] Fix mypy for `vllm/v1/structured_output` (#32722) · 7ef58737
Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
7ef58737

22 Jan, 2026 2 commits
- [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 (#32795) · 955b43a5
  Matthew Bonanni authored Jan 22, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  955b43a5
- [FlashMLA] Update FlashMLA to expose new arguments (#32810) · 889722f3
  Lucas Wilkinson authored Jan 21, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  889722f3
21 Jan, 2026 2 commits
- [ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287) · 6c20e89c
  Pleaplusone authored Jan 21, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  6c20e89c
- Update FlashMLA (#32491) · b4f64e5b
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b4f64e5b
17 Jan, 2026 1 commit
- [Misc] Fix typo: seperator -> separator in flashmla_sparse.py (#32411) · 2b99f210
  Guofang.Tang authored Jan 17, 2026
```
Signed-off-by: Guofang Tang <tinggofun@gmail.com>
Co-authored-by: Guofang Tang <tinggofun@gmail.com>
```
  2b99f210
13 Jan, 2026 2 commits

[4/N][Attention] Move MLA common to model_executor (#32060) · 2263d44b

Matthew Bonanni authored Jan 13, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2263d44b

[Quantization] fix: overflow with static per-tensor scaling (#29867) · a5bbbd2f

Mickaël Seznec authored Jan 13, 2026


Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

a5bbbd2f

12 Jan, 2026 1 commit
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
07 Jan, 2026 4 commits
- [Chore] Migrate V0 attention utils (#31891) · b665bbc2
  Cyrus Leung authored Jan 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b665bbc2
- [ROCm][AITER] fix wrong argument passed to AITER `flash_attn_varlen_func` (#31880) · 41cfa506
  vllmellm authored Jan 07, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  41cfa506
- [ROCm][AITER] bugfix accuracy regression in ROCM_AITER_TRITON_MLA backend (#31816) · 6409004b
  vllmellm authored Jan 07, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  6409004b
- fixed mypy warnings for files vllm/v1/attention with TEMPORARY workaround (#31465) · 0a2c2dc3
  Jack Yang authored Jan 06, 2026
```
Signed-off-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  0a2c2dc3
06 Jan, 2026 1 commit

[Attention][1/n] Remove usage of deprecated `seq_lens_cpu` and... · e0327c9d

Lucas Wilkinson authored Jan 06, 2026


[Attention][1/n] Remove usage of deprecated `seq_lens_cpu` and `num_computed_tokens_cpu` CommonAttentionMetadata properties (#31773)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

e0327c9d

02 Jan, 2026 1 commit
- [Bugfix][Hardware][AMD] Fix last_page_len calculation in AITER MLA decode (#31282) · 825c2dc1
  Kevin McKay authored Jan 01, 2026
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  825c2dc1
31 Dec, 2025 1 commit

[Bug] Fix log issue with `\n` (#31390) · 357d435c

Wentao Ye authored Dec 31, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

357d435c

23 Dec, 2025 1 commit
- Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3e102623
22 Dec, 2025 2 commits
- [Bug] Fix `'CutlassMLAImpl' object has no attribute '_workspace_buffer'` (#31173) · 5312a728
  Wentao Ye authored Dec 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5312a728
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476