Commits · b4f64e5b02a949c8856c9f81990b77ca56296cdc · OpenDAS / vllm_cscc

21 Jan, 2026 1 commit
- Update FlashMLA (#32491) · b4f64e5b
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b4f64e5b
08 Jan, 2026 1 commit
- [chore] Update FA commit (#30460) · be6a81f3
  Lucas Wilkinson authored Jan 08, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  be6a81f3
05 Jan, 2026 1 commit
- [BugFix] Fix architecture flags to prevent issues on SM103 (#31150) · fdcc5176
  Roberto L. Castro authored Jan 05, 2026
```
Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
```
  fdcc5176
15 Dec, 2025 1 commit
- [BUILD] use sm_100f when compiling flashmla to fix support on sm103 (#30705) · 511e81e7
  Shengqi Chen authored Dec 16, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  511e81e7
21 Nov, 2025 1 commit
- [BugFix] Fix missing symbol triggering FA2 fallback on Hopper (#29107) · c68c7b40
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  c68c7b40
19 Nov, 2025 2 commits
- [Attention] FlashAttention ViT support, make default backend (#28763) · 4c23690f
  Matthew Bonanni authored Nov 18, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4c23690f
- [Build] Add OpenAI triton_kernels (#28788) · 9912b8cc
  Varun Sundar Rabindranath authored Nov 18, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  9912b8cc
14 Nov, 2025 1 commit

[Attention] Bump FA for removed method (#28429) · 8cc40f89

Matthew Bonanni authored Nov 14, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8cc40f89

10 Nov, 2025 1 commit

[FA/Chore] Bump FA version for FP8 two-level accumulation (#27889) · 9c84ca82

Jonas M. Kübler authored Nov 10, 2025


Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

9c84ca82

08 Nov, 2025 1 commit
- Refactor CPU/GPU extension targets for CMake build (#28026) · d15afc1f
  Abolfazl Shahbazi authored Nov 07, 2025
```
Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
```
  d15afc1f
22 Oct, 2025 1 commit
- [MLA] Bump FlashMLA (#27354) · b4fda58a
  Matthew Bonanni authored Oct 22, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  b4fda58a
21 Oct, 2025 1 commit

[Bugfix] fixes the decoding metadata of dense mla's fp8 kvcache. (#27144) · 250fb1b8

Tao He authored Oct 22, 2025


Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

250fb1b8

18 Oct, 2025 1 commit

[BugFix] Fix failing gemma-3-1b-it test:... · 9f020f4f

Lucas Wilkinson authored Oct 18, 2025


[BugFix] Fix failing gemma-3-1b-it test: `test_lm_eval_accuracy_v1_engine[google/gemma-3-1b-it]` (#27111)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

9f020f4f

15 Oct, 2025 1 commit
- [CI/Build][Bugfix] fix qutlass cmake error when set QUTLASS_SRC_DIR (#26773) · e471d7ca
  zhrrr authored Oct 15, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e471d7ca
10 Oct, 2025 1 commit

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440) · 96ad65b7

Roberto L. Castro authored Oct 10, 2025


Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

96ad65b7

09 Oct, 2025 1 commit
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
02 Oct, 2025 1 commit
- [FA/Chore] Bump vllm-flash-attention (#25537) · 418d111f
  Lucas Wilkinson authored Oct 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  418d111f
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

04 Sep, 2025 1 commit

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

22 Aug, 2025 1 commit
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
17 Aug, 2025 1 commit
- [BugFix] Fix for IMA in FA3 varlen combine (#22967) · 292084e7
  Lucas Wilkinson authored Aug 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  292084e7
15 Aug, 2025 1 commit
- [Attention] FA3 Attention Sinks Perf Boost (#22478) · 177e55e3
  Lucas Wilkinson authored Aug 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  177e55e3
08 Aug, 2025 2 commits

[Bugfix] Update FA commit hash (#22546) · bd875d2e
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
bd875d2e

[BugFix] Fix IMA FlashMLA full cuda-graph and DP + Update FlashMLA (#21691) · cd9b9de1

Lucas Wilkinson authored Aug 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

cd9b9de1

06 Aug, 2025 2 commits
- [BugFix] Fix FA2 RuntimeError when sinks is provided (#22365) · 2cb6ef89
  Lucas Wilkinson authored Aug 06, 2025
```
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
```
  2cb6ef89
- Upgrade FA3 for attention sink (#22313) · e3c876dc
  Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e3c876dc
01 Jul, 2025 1 commit
- [CUDA graphs] Enable full cuda graphs with FA3 AoT scheduling (#20301) · 8acb4bad
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8acb4bad
24 Jun, 2025 2 commits
- cmake: Update vllm_flash_attn for vllm_kernels (#20032) · 0d06b533
  Eli Uriegas authored Jun 24, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  0d06b533
- [Perf] Improve/Fix-regression for FA3 in High QPS regimes (#19463) · a045b7e8
  Lucas Wilkinson authored Jun 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  a045b7e8
17 Jun, 2025 1 commit
- [Wheel Size] Only build FA2 8.0+PTX (#19336) · 07334959
  Lucas Wilkinson authored Jun 16, 2025
  
  07334959
28 May, 2025 1 commit
- [Build] Fixes for CMake install (#18570) · a3896c7f
  Luka Govedič authored May 27, 2025
  
  a3896c7f
25 Apr, 2025 2 commits
- [Perf]Optimize rotary_emb implementation to use Triton operator for improved... · b22980a1
  yexin(叶鑫) authored Apr 25, 2025
```
[Perf]Optimize rotary_emb implementation to use Triton operator for improved inference performance (#16457)
Signed-off-by: cynthieye <yexin93@qq.com>
Co-authored-by: MagnetoWang <magnetowang@outlook.com>
```
  b22980a1
- [Attention] FA3 decode perf improvement - single mma warp group support for head dim 128 (#16864) · 41ca7eb4
  Lucas Wilkinson authored Apr 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  41ca7eb4
17 Apr, 2025 1 commit
- [Attention] Update to lastest FA3 code (#13111) · 183dad7a
  Lucas Wilkinson authored Apr 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  183dad7a
20 Mar, 2025 1 commit
- [Attention] Flash Attention 3 - fp8 (#14570) · a597a575
  Mickaël Seznec authored Mar 20, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  a597a575
06 Mar, 2025 1 commit
- [Hardware] Update the flash attn tag to support Blackwell (#14244) · ed6ea065
  Pavani Majety authored Mar 05, 2025
  
  ed6ea065
27 Feb, 2025 1 commit

[Kernel] FlashMLA integration (#13747) · f9590390

Lucas Wilkinson authored Feb 26, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

f9590390