Commits · cd089597fdde59d5e413ae055f1845ff8475af4d · gaoqiong / flash-attention

27 Nov, 2023 1 commit
- Fix performance regression with causal · b4bf9cc1
  Tri Dao authored Nov 26, 2023
  
  b4bf9cc1
20 Nov, 2023 1 commit
- add checks (#640) · dc4b9ad6
  Driss Guessous authored Nov 19, 2023
  
  dc4b9ad6
08 Oct, 2023 1 commit
- Change constexpr int to constexpr static int · 5a834254
  Tri Dao authored Oct 08, 2023
  
  5a834254
26 Sep, 2023 1 commit
- Implement local attention · 083e8f52
  Tri Dao authored Sep 24, 2023
```
Co-authored-by: Timothee Lacroix <t@mistral.ai>
```
  083e8f52
24 Sep, 2023 1 commit
- Reduce number of templates for headdim > 128 · 1879e089
  Tri Dao authored Sep 23, 2023
  
  1879e089
21 Sep, 2023 1 commit
- Swap seqlen_q and ngroups when seqlen_q=1 (h/t Daniel Haziza) · 2d8ea9a5
  Tri Dao authored Sep 20, 2023
  
  2d8ea9a5
18 Sep, 2023 1 commit
- Remove template for (IsEvenMN=T, IsEvenK=F) to speed up compilation · 43617dea
  Tri Dao authored Sep 18, 2023
  
  43617dea
04 Sep, 2023 1 commit
- Remove constexpr in launch template to fix CI compilation · 6a89b2f1
  Tri Dao authored Sep 03, 2023
  
  6a89b2f1
01 Sep, 2023 1 commit
- Remove commented out code in bwd (#512) · 37e32feb
  Sophia Wisdom authored Sep 01, 2023
```
* Remove lots of comments

* Remove unused traits
```
  37e32feb
29 Aug, 2023 1 commit
- Implement splitKV attention · b1fbbd83
  Tri Dao authored Aug 29, 2023
  
  b1fbbd83
01 Aug, 2023 1 commit
- Fix masking of bwd when seqlen is not divisible by 128 · a4f148b6
  Tri Dao authored Jul 31, 2023
  
  a4f148b6
17 Jul, 2023 1 commit
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35