Commits · cd9b9de1fb009cf607403ba08961f2a3f869931d · OpenDAS / vllm_cscc

08 Aug, 2025 1 commit

[BugFix] Fix IMA FlashMLA full cuda-graph and DP + Update FlashMLA (#21691) · cd9b9de1

Lucas Wilkinson authored Aug 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

cd9b9de1

06 Aug, 2025 2 commits
- [BugFix] Fix FA2 RuntimeError when sinks is provided (#22365) · 2cb6ef89
  Lucas Wilkinson authored Aug 06, 2025
```
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
```
  2cb6ef89
- Upgrade FA3 for attention sink (#22313) · e3c876dc
  Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e3c876dc
01 Jul, 2025 1 commit
- [CUDA graphs] Enable full cuda graphs with FA3 AoT scheduling (#20301) · 8acb4bad
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8acb4bad
24 Jun, 2025 2 commits
- cmake: Update vllm_flash_attn for vllm_kernels (#20032) · 0d06b533
  Eli Uriegas authored Jun 24, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  0d06b533
- [Perf] Improve/Fix-regression for FA3 in High QPS regimes (#19463) · a045b7e8
  Lucas Wilkinson authored Jun 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  a045b7e8
17 Jun, 2025 1 commit
- [Wheel Size] Only build FA2 8.0+PTX (#19336) · 07334959
  Lucas Wilkinson authored Jun 16, 2025
  
  07334959
28 May, 2025 1 commit
- [Build] Fixes for CMake install (#18570) · a3896c7f
  Luka Govedič authored May 27, 2025
  
  a3896c7f
25 Apr, 2025 2 commits
- [Perf]Optimize rotary_emb implementation to use Triton operator for improved... · b22980a1
  yexin(叶鑫) authored Apr 25, 2025
```
[Perf]Optimize rotary_emb implementation to use Triton operator for improved inference performance (#16457)
Signed-off-by: cynthieye <yexin93@qq.com>
Co-authored-by: MagnetoWang <magnetowang@outlook.com>
```
  b22980a1
- [Attention] FA3 decode perf improvement - single mma warp group support for head dim 128 (#16864) · 41ca7eb4
  Lucas Wilkinson authored Apr 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  41ca7eb4
17 Apr, 2025 1 commit
- [Attention] Update to lastest FA3 code (#13111) · 183dad7a
  Lucas Wilkinson authored Apr 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  183dad7a
20 Mar, 2025 1 commit
- [Attention] Flash Attention 3 - fp8 (#14570) · a597a575
  Mickaël Seznec authored Mar 20, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  a597a575
06 Mar, 2025 1 commit
- [Hardware] Update the flash attn tag to support Blackwell (#14244) · ed6ea065
  Pavani Majety authored Mar 05, 2025
  
  ed6ea065
27 Feb, 2025 1 commit

[Kernel] FlashMLA integration (#13747) · f9590390

Lucas Wilkinson authored Feb 26, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

f9590390