Commits · 5cdabc2809095b98c311283125c05d222500c8ff · gaoqiong / flash-attention

28 Nov, 2023 1 commit
- [CI] Only compile for CUDA 11.8 & 12.2, MAX_JOBS=2,add torch-nightly · d4a7c8ff
  Tri Dao authored Nov 27, 2023
  
  d4a7c8ff
04 Oct, 2023 1 commit
- [CI] Use official Pytorch 2.1, add CUDA 11.8 for Pytorch 2.1 · 5e525a8d
  Tri Dao authored Oct 03, 2023
  
  5e525a8d
24 Sep, 2023 1 commit
- Reduce number of templates for headdim > 128 · 1879e089
  Tri Dao authored Sep 23, 2023
  
  1879e089
22 Sep, 2023 1 commit
- Re-enable compilation for Hopper · bff31471
  Tri Dao authored Sep 21, 2023
  
  bff31471
18 Sep, 2023 3 commits
- [Gen] Don't use ft_attention, use flash_attn_with_kvcache instead · dfe29f5e
  Tri Dao authored Sep 18, 2023
  
  dfe29f5e
- [Minor] add nvcc note on bare_metal_version `RuntimeError` (#552) · fa3ddcba
  Federico Berto authored Sep 19, 2023
```
* Add nvcc note on bare_metal_version `RuntimeError`

* Run Black formatting
```
  fa3ddcba
- Don't compile for Pytorch 2.1 on CUDA 12.1 due to nvcc segfaults · 799f56fa
  Tri Dao authored Sep 17, 2023
  
  799f56fa
12 Sep, 2023 1 commit
- Remove some unused headers · bb9beb36
  Tri Dao authored Sep 12, 2023
  
  bb9beb36
04 Sep, 2023 1 commit
- Require CUDA 11.6+, clean up setup.py · 0c04943f
  Tri Dao authored Sep 03, 2023
  
  0c04943f
29 Aug, 2023 1 commit
- Implement splitKV attention · b1fbbd83
  Tri Dao authored Aug 29, 2023
  
  b1fbbd83
18 Aug, 2023 1 commit
- Don't need to set TORCH_CUDA_ARCH_LIST in setup.py · cbb4cf5f
  Tri Dao authored Aug 18, 2023
  
  cbb4cf5f
14 Aug, 2023 2 commits
- fix binary wheel installation when nvcc is not available (#448) · aab603af
  Aman Gupta Karmani authored Aug 14, 2023
  
  aab603af
- Use single thread compilation for cuda12.1, torch2.1 to avoid OOM CI · 9c531bdc
  Tri Dao authored Aug 14, 2023
  
  9c531bdc
13 Aug, 2023 1 commit
- Fix wheel building · 2ddeaa40
  Tri Dao authored Aug 13, 2023
  
  2ddeaa40
01 Aug, 2023 1 commit
- Fix race condition in bwd (overwriting sK) · 1c41d2b0
  Tri Dao authored Aug 01, 2023
  
  1c41d2b0
17 Jul, 2023 1 commit
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35
08 Jun, 2023 2 commits
- Clean setup.py imports · 9af165c3
  Pierce Freeman authored Jun 07, 2023
  
  9af165c3
- Add notes to github action workflow · 494b2aa4
  Pierce Freeman authored Jun 04, 2023
  
  494b2aa4
03 Jun, 2023 6 commits
- Refactor and clean of setup.py · ea2ed886
  Pierce Freeman authored Jun 02, 2023
  
  ea2ed886
- Strip cuda name from torch version · 9fc9820a
  Pierce Freeman authored Jun 02, 2023
  
  9fc9820a
- Allow fallback install · 5e469978
  Pierce Freeman authored Jun 02, 2023
  
  5e469978
- Guessing wheel URL · 0e7769c8
  Pierce Freeman authored Jun 02, 2023
  
  0e7769c8
- Raise cuda error on build · e1faefce
  Pierce Freeman authored Jun 02, 2023
  
  e1faefce
- Scaffolding for wheel prototype · add4f0bc
  Pierce Freeman authored May 30, 2023
  
  add4f0bc
19 May, 2023 1 commit
- Allow adding an optional local version to the package version · 31f78a98
  Max H. Gerlach authored May 19, 2023
  
  31f78a98
12 May, 2023 1 commit
- Add ninja to pyproject.toml build-system, bump to v1.0.5 · eff9fe6b
  Tri Dao authored May 12, 2023
  
  eff9fe6b
26 Apr, 2023 1 commit
- [Docs] Clearer error message for bwd d > 64, bump to v1.0.4 · ad113948
  Tri Dao authored Apr 26, 2023
  
  ad113948
21 Apr, 2023 2 commits
- Bump version to v1.0.3.post0 · fbbb1078
  Tri Dao authored Apr 21, 2023
  
  fbbb1078
- Bump version to 1.0.3 · 67ef5d28
  Tri Dao authored Apr 21, 2023
  
  67ef5d28
16 Apr, 2023 1 commit
- Bump to v1.0.2 · df1344f8
  Tri Dao authored Apr 15, 2023
  
  df1344f8
14 Apr, 2023 1 commit
- add missed module · 72629ac9
  Pavel Shvets authored Apr 14, 2023
  
  72629ac9
12 Apr, 2023 2 commits
- Bump version to v1.0.1, fix Cutlass version · 853ff729
  Tri Dao authored Apr 12, 2023
  
  853ff729
- Bump version to 1.0.0 · 74af0233
  Tri Dao authored Apr 11, 2023
  
  74af0233
15 Mar, 2023 2 commits
- Support H100 for other CUDA extensions · dc08ea1c
  Tri Dao authored Mar 15, 2023
  
  dc08ea1c
- Support H100 · 1b18f1b7
  Tri Dao authored Mar 15, 2023
  
  1b18f1b7
19 Jan, 2023 1 commit
- Bump to v0.2.8 · 33e0860c
  Tri Dao authored Jan 19, 2023
  
  33e0860c
13 Jan, 2023 1 commit

[Compilation] Add _NO_HALF2 flags to be consistent with Pytorch · d5098324

Tri Dao authored Jan 12, 2023

https://github.com/pytorch/pytorch/blob/eb7b89771e989f832147b8f28f62c0b43d5d3c12/cmake/Dependencies.cmake#L1693

d5098324

07 Jan, 2023 1 commit
- Bump to v0.2.7 · ce26d3d7
  Tri Dao authored Jan 06, 2023
  
  ce26d3d7
28 Dec, 2022 1 commit
- Bump to v0.2.6 · a6ec1782
  Tri Dao authored Dec 27, 2022
  
  a6ec1782
21 Dec, 2022 1 commit
- Bump to v0.2.5 · 1bc6e5b0
  Tri Dao authored Dec 21, 2022
  
  1bc6e5b0