Commits · 799f56fa90f73a4bd27f8bdca25bcdcb5d27bad0 · gaoqiong / flash-attention

18 Sep, 2023 1 commit
- Don't compile for Pytorch 2.1 on CUDA 12.1 due to nvcc segfaults · 799f56fa
  Tri Dao authored Sep 17, 2023
  
  799f56fa
17 Sep, 2023 1 commit
- Set block size to 64 x 64 for kvcache to avoid nvcc segfaults · c984208d
  Tri Dao authored Sep 17, 2023
  
  c984208d
16 Sep, 2023 1 commit
- Bump to v2.2.3 · 8c8b4d36
  Tri Dao authored Sep 16, 2023
  
  8c8b4d36
11 Sep, 2023 1 commit
- Bump to v2.2.2 · 08c295c0
  Tri Dao authored Sep 10, 2023
  
  08c295c0
06 Sep, 2023 1 commit
- Bump to v2.2.1 · a1576ad1
  Tri Dao authored Sep 06, 2023
  
  a1576ad1
05 Sep, 2023 1 commit
- Bump to v2.2.0 · 6d673cd9
  Tri Dao authored Sep 05, 2023
  
  6d673cd9
04 Sep, 2023 5 commits
- Implement flash_attn_with_kvcache · 37c6e054
  Tri Dao authored Sep 04, 2023
  
  37c6e054
- Set single threaded compilation for CUDA 12.2 so CI doesn't OOM · 4976650f
  Tri Dao authored Sep 03, 2023
  
  4976650f
- Remove constexpr in launch template to fix CI compilation · 6a89b2f1
  Tri Dao authored Sep 03, 2023
  
  6a89b2f1
- Try switching back to Cutlass 3.2.0 · 97ba7a62
  Tri Dao authored Sep 03, 2023
  
  97ba7a62
- Bump to v2.1.2 · 1dc1b6c8
  Tri Dao authored Sep 03, 2023
  
  1dc1b6c8
28 Aug, 2023 1 commit
- Update Cutlass to v3.2.0 · 757058d4
  Tri Dao authored Aug 27, 2023
  
  757058d4
25 Aug, 2023 1 commit
- Change causal mask to be aligned to bottom-right instead of top-left · 9e5e8bc9
  Tri Dao authored Aug 21, 2023
  
  9e5e8bc9
22 Aug, 2023 1 commit
- Bump version to 2.0.9 · 6711b3bc
  Tri Dao authored Aug 22, 2023
  
  6711b3bc
18 Aug, 2023 1 commit
- Run isort and black on python files · f1a73d07
  Tri Dao authored Aug 18, 2023
  
  f1a73d07
16 Aug, 2023 1 commit
- Fix Bwd NaN for varlen when seqlen_q >> seqlen_k and causal · c65b5106
  Tri Dao authored Aug 16, 2023
  
  c65b5106
14 Aug, 2023 3 commits
- Bump to v2.0.7 · c60851a8
  Tri Dao authored Aug 14, 2023
  
  c60851a8
- [CI] Fix MATRIX_CUDA_VERSION check · f8dccfc9
  Tri Dao authored Aug 14, 2023
  
  f8dccfc9
- Use single thread compilation for cuda12.1, torch2.1 to avoid OOM CI · 9c531bdc
  Tri Dao authored Aug 14, 2023
  
  9c531bdc
13 Aug, 2023 2 commits
- Bump to v2.0.6 · 67ae6fd7
  Tri Dao authored Aug 13, 2023
  
  67ae6fd7
- Bump to v2.0.5 · c5e87b11
  Tri Dao authored Aug 13, 2023
  
  c5e87b11
01 Aug, 2023 2 commits
- Bump to v2.0.4 · d30f2e1c
  Tri Dao authored Aug 01, 2023
  
  d30f2e1c
- Bump to v2.0.3 · a4e5d1ed
  Tri Dao authored Jul 31, 2023
  
  a4e5d1ed
28 Jul, 2023 1 commit

Kirthi Shankar Sivamani authored Jul 28, 2023



* Bump version to 2.0.2
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Update version in Dockerfile
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

---------
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

32a953f4

23 Jul, 2023 1 commit
- Bump to v2.0.1 · b2520724
  Tri Dao authored Jul 23, 2023
  
  b2520724
17 Jul, 2023 2 commits
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35
- Bump to v1.0.9 · 6d48e14a
  Tri Dao authored Jul 17, 2023
  
  6d48e14a
03 Jul, 2023 1 commit
- Bump to v1.0.8 · 9610114c
  Tri Dao authored Jul 02, 2023
  
  9610114c
08 Jun, 2023 2 commits
- Bump version · 6c730dc8
  Pierce Freeman authored Jun 07, 2023
  
  6c730dc8
- Add notes to github action workflow · 494b2aa4
  Pierce Freeman authored Jun 04, 2023
  
  494b2aa4
30 May, 2023 1 commit
- Bump version to 1.0.7 · 85b51d61
  Tri Dao authored May 30, 2023
  
  85b51d61
27 May, 2023 1 commit
- bump to v1.0.6 · dd9c3a1f
  Kirthi Shankar Sivamani authored May 26, 2023
```
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
```
  dd9c3a1f
19 May, 2023 1 commit
- Allow adding an optional local version to the package version · 31f78a98
  Max H. Gerlach authored May 19, 2023
  
  31f78a98
03 Jul, 2022 1 commit
- Add missing __init__.py · af4a9ce0
  Gustaf authored Jul 03, 2022
  
  af4a9ce0