Commits · 83aef842beec1037eb8c1d9c3ef3ed8aae80b091 · gaoqiong / flash-attention

24 Oct, 2023 1 commit
- Bump to v2.3.3 · 83aef842
  Tri Dao authored Oct 24, 2023
  
  83aef842
09 Oct, 2023 1 commit
- Bump to v2.3.2 · 7f31e7c1
  Tri Dao authored Oct 08, 2023
  
  7f31e7c1
04 Oct, 2023 2 commits
- [CI] Use official Pytorch 2.1, add CUDA 11.8 for Pytorch 2.1 · 5e525a8d
  Tri Dao authored Oct 03, 2023
  
  5e525a8d
- Bump to v2.3.1 · 21c3b0d8
  Tri Dao authored Oct 03, 2023
  
  21c3b0d8
27 Sep, 2023 1 commit
- Bump to v2.3.0 · 601b4dc4
  Tri Dao authored Sep 26, 2023
  
  601b4dc4
24 Sep, 2023 1 commit
- Bump to v2.2.5 · 0a1d03c7
  Tri Dao authored Sep 24, 2023
  
  0a1d03c7
22 Sep, 2023 1 commit
- Re-enable compilation for Hopper · bff31471
  Tri Dao authored Sep 21, 2023
  
  bff31471
21 Sep, 2023 1 commit
- Bump to v2.2.4 · 229080b9
  Tri Dao authored Sep 20, 2023
  
  229080b9
18 Sep, 2023 1 commit
- Don't compile for Pytorch 2.1 on CUDA 12.1 due to nvcc segfaults · 799f56fa
  Tri Dao authored Sep 17, 2023
  
  799f56fa
17 Sep, 2023 1 commit
- Set block size to 64 x 64 for kvcache to avoid nvcc segfaults · c984208d
  Tri Dao authored Sep 17, 2023
  
  c984208d
16 Sep, 2023 1 commit
- Bump to v2.2.3 · 8c8b4d36
  Tri Dao authored Sep 16, 2023
  
  8c8b4d36
11 Sep, 2023 1 commit
- Bump to v2.2.2 · 08c295c0
  Tri Dao authored Sep 10, 2023
  
  08c295c0
06 Sep, 2023 1 commit
- Bump to v2.2.1 · a1576ad1
  Tri Dao authored Sep 06, 2023
  
  a1576ad1
05 Sep, 2023 1 commit
- Bump to v2.2.0 · 6d673cd9
  Tri Dao authored Sep 05, 2023
  
  6d673cd9
04 Sep, 2023 5 commits
- Implement flash_attn_with_kvcache · 37c6e054
  Tri Dao authored Sep 04, 2023
  
  37c6e054
- Set single threaded compilation for CUDA 12.2 so CI doesn't OOM · 4976650f
  Tri Dao authored Sep 03, 2023
  
  4976650f
- Remove constexpr in launch template to fix CI compilation · 6a89b2f1
  Tri Dao authored Sep 03, 2023
  
  6a89b2f1
- Try switching back to Cutlass 3.2.0 · 97ba7a62
  Tri Dao authored Sep 03, 2023
  
  97ba7a62
- Bump to v2.1.2 · 1dc1b6c8
  Tri Dao authored Sep 03, 2023
  
  1dc1b6c8
28 Aug, 2023 1 commit
- Update Cutlass to v3.2.0 · 757058d4
  Tri Dao authored Aug 27, 2023
  
  757058d4
25 Aug, 2023 1 commit
- Change causal mask to be aligned to bottom-right instead of top-left · 9e5e8bc9
  Tri Dao authored Aug 21, 2023
  
  9e5e8bc9
22 Aug, 2023 1 commit
- Bump version to 2.0.9 · 6711b3bc
  Tri Dao authored Aug 22, 2023
  
  6711b3bc
18 Aug, 2023 1 commit
- Run isort and black on python files · f1a73d07
  Tri Dao authored Aug 18, 2023
  
  f1a73d07
16 Aug, 2023 1 commit
- Fix Bwd NaN for varlen when seqlen_q >> seqlen_k and causal · c65b5106
  Tri Dao authored Aug 16, 2023
  
  c65b5106
14 Aug, 2023 3 commits
- Bump to v2.0.7 · c60851a8
  Tri Dao authored Aug 14, 2023
  
  c60851a8
- [CI] Fix MATRIX_CUDA_VERSION check · f8dccfc9
  Tri Dao authored Aug 14, 2023
  
  f8dccfc9
- Use single thread compilation for cuda12.1, torch2.1 to avoid OOM CI · 9c531bdc
  Tri Dao authored Aug 14, 2023
  
  9c531bdc
13 Aug, 2023 2 commits
- Bump to v2.0.6 · 67ae6fd7
  Tri Dao authored Aug 13, 2023
  
  67ae6fd7
- Bump to v2.0.5 · c5e87b11
  Tri Dao authored Aug 13, 2023
  
  c5e87b11
01 Aug, 2023 2 commits
- Bump to v2.0.4 · d30f2e1c
  Tri Dao authored Aug 01, 2023
  
  d30f2e1c
- Bump to v2.0.3 · a4e5d1ed
  Tri Dao authored Jul 31, 2023
  
  a4e5d1ed
28 Jul, 2023 1 commit

Kirthi Shankar Sivamani authored Jul 28, 2023



* Bump version to 2.0.2
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Update version in Dockerfile
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

---------
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

32a953f4

23 Jul, 2023 1 commit
- Bump to v2.0.1 · b2520724
  Tri Dao authored Jul 23, 2023
  
  b2520724
17 Jul, 2023 2 commits
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35
- Bump to v1.0.9 · 6d48e14a
  Tri Dao authored Jul 17, 2023
  
  6d48e14a
03 Jul, 2023 1 commit
- Bump to v1.0.8 · 9610114c
  Tri Dao authored Jul 02, 2023
  
  9610114c
08 Jun, 2023 2 commits
- Bump version · 6c730dc8
  Pierce Freeman authored Jun 07, 2023
  
  6c730dc8
- Add notes to github action workflow · 494b2aa4
  Pierce Freeman authored Jun 04, 2023
  
  494b2aa4
30 May, 2023 1 commit
- Bump version to 1.0.7 · 85b51d61
  Tri Dao authored May 30, 2023
  
  85b51d61
27 May, 2023 1 commit
- bump to v1.0.6 · dd9c3a1f
  Kirthi Shankar Sivamani authored May 26, 2023
```
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
```
  dd9c3a1f