Commits · 5beacce2eae2cb36e44498e2ea80b2d3ee34fe61 · OpenDAS / vllm_cscc

22 Oct, 2025 1 commit
- [BugFix] bugfix for Flash Attention MLA with full cuda graph IMA following pr-25490 (#27128) · 5beacce2
  Daisy-Ma-coder authored Oct 22, 2025
```
Signed-off-by: qqma <qqma@amazon.com>
Co-authored-by: qqma <qqma@amazon.com>
```
  5beacce2
21 Oct, 2025 1 commit

[Bugfix] fixes the decoding metadata of dense mla's fp8 kvcache. (#27144) · 250fb1b8

Tao He authored Oct 22, 2025


Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

250fb1b8

16 Oct, 2025 2 commits
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
14 Oct, 2025 1 commit
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
13 Oct, 2025 1 commit
- [Log] Optimize Startup Log (#26601) · e251e457
  Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e251e457
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit
- [deepseek] kernel block size for UniformTypeKVCacheSpecs (#26559) · 6f0f570c
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6f0f570c
09 Oct, 2025 2 commits
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
08 Oct, 2025 2 commits
- [Attention] Register FLASHMLA_SPARSE (#26441) · 2a03f93d
  Matthew Bonanni authored Oct 08, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2a03f93d
- [Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125) · f80e7866
  Lucas Wilkinson authored Oct 07, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f80e7866
07 Oct, 2025 1 commit
- [Spec Decode] Enable efficient speculative decoding with FlashInfer-MLA (#25984) · 3d1f6761
  Benjamin Chislett authored Oct 07, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  3d1f6761
06 Oct, 2025 2 commits
- [Perf] Add decode full-graph support to FlashInfer-MLA backend (#26313) · f77df946
  Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  f77df946
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
02 Oct, 2025 2 commits

[Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
1e50f1be

[BugFix] Fix FI accuracy issue when used for MLA prefill (#26063) · decf7f79

Lucas Wilkinson authored Oct 02, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

decf7f79

01 Oct, 2025 1 commit
- [Model] MTP fallback to eager for DeepSeek v32 (#25982) · 001e50c9
  Lucia Fang authored Sep 30, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  001e50c9
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

25 Sep, 2025 2 commits
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
- [Kernel] Support DCP for Triton backend (#25132) · 05c19485
  Wei Wei authored Sep 24, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  05c19485
24 Sep, 2025 2 commits

[Spec Decode] Enable FlashInfer Spec Decoding (#25196) · c30b405b

Benjamin Chislett authored Sep 23, 2025


Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: lhsjohn <huashuoli@tencent.com>

c30b405b

[BugFix] Fix MLA assert with CUTLASS MLA (#25478) · 9df8da54
Lucas Wilkinson authored Sep 23, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
9df8da54

23 Sep, 2025 2 commits
- [Bug] Fix Long Context OOM Issue (#25290) · 4741239d
  Wentao Ye authored Sep 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4741239d
- [Performance] Remove input pads in cutlass_mla and optimize v_proj output handling (#25184) · 0b7bed9c
  Alexander Matveev authored Sep 22, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  0b7bed9c
22 Sep, 2025 1 commit

[CLI env var] Add VLLM_FLASH_ATTN_MAX_NUM_SPLITS_FOR_CUDA_GRAPH in env variables (#25274) · cfbee3d0

Daisy-Ma-coder authored Sep 22, 2025


Signed-off-by: qqma <qqma@amazon.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: qqma <qqma@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

cfbee3d0

19 Sep, 2025 1 commit
- allow disable flashinfer prefill (#25276) · ee7a66dd
  Lucia Fang authored Sep 19, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  ee7a66dd
18 Sep, 2025 1 commit

[Bug] Fix `returned_lse` not Defined issue (#25106) · 75fb112d

Wentao Ye authored Sep 18, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

75fb112d

17 Sep, 2025 1 commit

Remove old cutlass mla (#23961) · 8f3616f4

Matthew Bonanni authored Sep 17, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

8f3616f4

16 Sep, 2025 1 commit
- [Bug] Fix `is_flashmla_supported` Check Error (#24774) · b42566f4
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42566f4
15 Sep, 2025 1 commit
- [Performance] Remove redundant clone() calls in cutlass_mla (#24891) · aae725af
  Alexander Matveev authored Sep 15, 2025
  
  aae725af
12 Sep, 2025 1 commit
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
11 Sep, 2025 2 commits
- fix some typos (#24616) · e26fef83
  co63oc authored Sep 12, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  e26fef83
- [Doc]: fixing doc typos (#24635) · e2b1f863
  Didier Durand authored Sep 11, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  e2b1f863
10 Sep, 2025 2 commits

[Kernel] Flashinfer MLA (trtllm-gen) decode kernel integration (#21078) · dcb28a33

Hanjie Qiu authored Sep 10, 2025


Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

dcb28a33

[Attention] add DCP support for FLASH_ATTN_MLA backend (#24453) · 0ae43dbf

Lucas Wilkinson authored Sep 10, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

0ae43dbf

09 Sep, 2025 1 commit

[Feature] Disallow FlashMLA on Blackwell (#24521) · 15de5ff9

Wentao Ye authored Sep 09, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

15de5ff9

08 Sep, 2025 1 commit

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc