Commits · b1fbbd833715505ad2f1fa131ad5e821a8f5dc57 · gaoqiong / flash-attention

29 Aug, 2023 1 commit
- Implement splitKV attention · b1fbbd83
  Tri Dao authored Aug 29, 2023
  
  b1fbbd83
18 Aug, 2023 1 commit
- Don't need to set TORCH_CUDA_ARCH_LIST in setup.py · cbb4cf5f
  Tri Dao authored Aug 18, 2023
  
  cbb4cf5f
14 Aug, 2023 2 commits
- fix binary wheel installation when nvcc is not available (#448) · aab603af
  Aman Gupta Karmani authored Aug 14, 2023
  
  aab603af
- Use single thread compilation for cuda12.1, torch2.1 to avoid OOM CI · 9c531bdc
  Tri Dao authored Aug 14, 2023
  
  9c531bdc
13 Aug, 2023 1 commit
- Fix wheel building · 2ddeaa40
  Tri Dao authored Aug 13, 2023
  
  2ddeaa40
01 Aug, 2023 1 commit
- Fix race condition in bwd (overwriting sK) · 1c41d2b0
  Tri Dao authored Aug 01, 2023
  
  1c41d2b0
17 Jul, 2023 1 commit
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35
08 Jun, 2023 2 commits
- Clean setup.py imports · 9af165c3
  Pierce Freeman authored Jun 07, 2023
  
  9af165c3
- Add notes to github action workflow · 494b2aa4
  Pierce Freeman authored Jun 04, 2023
  
  494b2aa4
03 Jun, 2023 6 commits
- Refactor and clean of setup.py · ea2ed886
  Pierce Freeman authored Jun 02, 2023
  
  ea2ed886
- Strip cuda name from torch version · 9fc9820a
  Pierce Freeman authored Jun 02, 2023
  
  9fc9820a
- Allow fallback install · 5e469978
  Pierce Freeman authored Jun 02, 2023
  
  5e469978
- Guessing wheel URL · 0e7769c8
  Pierce Freeman authored Jun 02, 2023
  
  0e7769c8
- Raise cuda error on build · e1faefce
  Pierce Freeman authored Jun 02, 2023
  
  e1faefce
- Scaffolding for wheel prototype · add4f0bc
  Pierce Freeman authored May 30, 2023
  
  add4f0bc
19 May, 2023 1 commit
- Allow adding an optional local version to the package version · 31f78a98
  Max H. Gerlach authored May 19, 2023
  
  31f78a98
12 May, 2023 1 commit
- Add ninja to pyproject.toml build-system, bump to v1.0.5 · eff9fe6b
  Tri Dao authored May 12, 2023
  
  eff9fe6b
26 Apr, 2023 1 commit
- [Docs] Clearer error message for bwd d > 64, bump to v1.0.4 · ad113948
  Tri Dao authored Apr 26, 2023
  
  ad113948
21 Apr, 2023 2 commits
- Bump version to v1.0.3.post0 · fbbb1078
  Tri Dao authored Apr 21, 2023
  
  fbbb1078
- Bump version to 1.0.3 · 67ef5d28
  Tri Dao authored Apr 21, 2023
  
  67ef5d28
16 Apr, 2023 1 commit
- Bump to v1.0.2 · df1344f8
  Tri Dao authored Apr 15, 2023
  
  df1344f8
14 Apr, 2023 1 commit
- add missed module · 72629ac9
  Pavel Shvets authored Apr 14, 2023
  
  72629ac9
12 Apr, 2023 2 commits
- Bump version to v1.0.1, fix Cutlass version · 853ff729
  Tri Dao authored Apr 12, 2023
  
  853ff729
- Bump version to 1.0.0 · 74af0233
  Tri Dao authored Apr 11, 2023
  
  74af0233
15 Mar, 2023 2 commits
- Support H100 for other CUDA extensions · dc08ea1c
  Tri Dao authored Mar 15, 2023
  
  dc08ea1c
- Support H100 · 1b18f1b7
  Tri Dao authored Mar 15, 2023
  
  1b18f1b7
19 Jan, 2023 1 commit
- Bump to v0.2.8 · 33e0860c
  Tri Dao authored Jan 19, 2023
  
  33e0860c
13 Jan, 2023 1 commit

[Compilation] Add _NO_HALF2 flags to be consistent with Pytorch · d5098324

Tri Dao authored Jan 12, 2023

https://github.com/pytorch/pytorch/blob/eb7b89771e989f832147b8f28f62c0b43d5d3c12/cmake/Dependencies.cmake#L1693

d5098324

07 Jan, 2023 1 commit
- Bump to v0.2.7 · ce26d3d7
  Tri Dao authored Jan 06, 2023
  
  ce26d3d7
28 Dec, 2022 1 commit
- Bump to v0.2.6 · a6ec1782
  Tri Dao authored Dec 27, 2022
  
  a6ec1782
21 Dec, 2022 1 commit
- Bump to v0.2.5 · 1bc6e5b0
  Tri Dao authored Dec 21, 2022
  
  1bc6e5b0
14 Dec, 2022 1 commit
- Bump to v0.2.4 · 04c4c610
  Tri Dao authored Dec 14, 2022
  
  04c4c610
13 Dec, 2022 1 commit
- Bump to v0.2.3 · a1a5d2ee
  Tri Dao authored Dec 13, 2022
  
  a1a5d2ee
26 Nov, 2022 1 commit
- Speed up compilation by splitting into separate .cu files · d95ee1a9
  Tri Dao authored Nov 25, 2022
  
  d95ee1a9
21 Nov, 2022 1 commit
- Bump version to 0.2.1 · 05481617
  Tri Dao authored Nov 20, 2022
  
  05481617
15 Nov, 2022 3 commits
- Set version to 0.2.0 (instead of 0.2) · d6ef701a
  Tri Dao authored Nov 15, 2022
  
  d6ef701a
- Update pip install instructions, bump to 0.2 · 4040256b
  Tri Dao authored Nov 15, 2022
  
  4040256b
- allow for uploading to pypi · b0eac329
  Phil Wang authored Nov 15, 2022
  
  b0eac329
05 Oct, 2022 1 commit
- Add C++17 arg to compiler, since C++17 features are used, fixes windows build · 9b1b011b
  Eric Engelhart authored Oct 03, 2022
  
  9b1b011b
03 Jul, 2022 1 commit
- Add einops installation to setup.py · 440e9c49
  Gustaf authored Jul 03, 2022
  
  440e9c49