Commits · 116f4be405ff8aaadbc885d8d527d1694c7fcf0a · OpenDAS / vllm_cscc

01 Apr, 2026 1 commit
- [1/N][Cleanup] Standardize on use of `is_quantized_kv_cache` (#38659) · 116f4be4
  Matthew Bonanni authored Apr 01, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  116f4be4
26 Mar, 2026 1 commit
- [Bugfix] Restore CUDA graph persistent buffers for FP8 FlashMLA decode (#35175) · 0aac2048
  haosdent authored Mar 27, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0aac2048
23 Mar, 2026 1 commit

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

16 Mar, 2026 1 commit
- [Misc] Add `float16` to `CacheDType` (#37199) · 93f3c8e5
  Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  93f3c8e5
09 Mar, 2026 1 commit
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
25 Feb, 2026 1 commit
- [Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  8ad54a99
31 Jan, 2026 1 commit
- [Attention] Move MLA `forward` from backend to layer (#33284) · aaa901ad
  Matthew Bonanni authored Jan 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aaa901ad
22 Jan, 2026 2 commits
- [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 (#32795) · 955b43a5
  Matthew Bonanni authored Jan 22, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  955b43a5
- [FlashMLA] Update FlashMLA to expose new arguments (#32810) · 889722f3
  Lucas Wilkinson authored Jan 21, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  889722f3
13 Jan, 2026 1 commit

[4/N][Attention] Move MLA common to model_executor (#32060) · 2263d44b

Matthew Bonanni authored Jan 13, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2263d44b

12 Jan, 2026 1 commit
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
22 Dec, 2025 1 commit
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
22 Nov, 2025 1 commit
- [Attention] Refactor FA `block_size` limitations to hybrid models only (#29084) · 066209a0
  Nicolò Lucchesi authored Nov 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  066209a0
12 Nov, 2025 1 commit

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding... · 30441957

Benjamin Chislett authored Nov 12, 2025


[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

30441957

11 Nov, 2025 1 commit

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

10 Nov, 2025 1 commit
- [V0 deprecation] Remove no longer used `get_metadata_cls` (#28370) · e8697faf
  Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e8697faf
03 Nov, 2025 1 commit
- [Bugfix] change FlashMLA reorder_batch_threshold (#27777) · 145c00a4
  Matthew Bonanni authored Nov 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  145c00a4
23 Oct, 2025 1 commit
- [Attention] Fix FlashMLA metadata builder arguments for q_len > 1 (#27368) · dbfbf9f3
  Matthew Bonanni authored Oct 23, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  dbfbf9f3
21 Oct, 2025 1 commit

[Bugfix] fixes the decoding metadata of dense mla's fp8 kvcache. (#27144) · 250fb1b8

Tao He authored Oct 22, 2025


Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

250fb1b8

16 Oct, 2025 2 commits
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
14 Oct, 2025 1 commit
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 2 commits
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
08 Oct, 2025 1 commit
- [Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125) · f80e7866
  Lucas Wilkinson authored Oct 07, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f80e7866
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

25 Sep, 2025 1 commit
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
16 Sep, 2025 1 commit
- [Bug] Fix `is_flashmla_supported` Check Error (#24774) · b42566f4
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42566f4
09 Sep, 2025 1 commit

[Feature] Disallow FlashMLA on Blackwell (#24521) · 15de5ff9

Wentao Ye authored Sep 09, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

15de5ff9

08 Sep, 2025 1 commit

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc

07 Sep, 2025 1 commit
- [attention][DCP] use AttentionImpl.need_to_return_lse_for_decode (#24372) · 558f0907
  youkaichao authored Sep 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  558f0907
06 Sep, 2025 1 commit

[Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e

yzds authored Sep 06, 2025


Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>

ac201a0e

04 Sep, 2025 1 commit

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

22 Aug, 2025 1 commit
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
15 Aug, 2025 1 commit

[Core] Allow full cudagraph with separate attention routines and orthogonal to... · 74f441f4

fhl2000 authored Aug 15, 2025


[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

74f441f4

08 Aug, 2025 1 commit

[BugFix] Fix IMA FlashMLA full cuda-graph and DP + Update FlashMLA (#21691) · cd9b9de1

Lucas Wilkinson authored Aug 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

cd9b9de1

02 Aug, 2025 1 commit
- [V1][CUDA] Full cudagraph support for FlashInfer (#21367) · 23322431
  fhl2000 authored Aug 02, 2025
  
  23322431