Commits · d562aa6354962fc48a9c76e8db7c29155c04af88 · gaoqiong / flash-attention

01 Aug, 2024 1 commit
- Sync with FA v2.6.0 to support soft capping (#13) · d562aa63
  Woosuk Kwon authored Jul 31, 2024
  
  d562aa63
30 Jan, 2024 1 commit

Preprocessor switches to control functionality (#788) · 0658e320

Jeremy Reizenstein authored Jan 30, 2024



For faster and smaller builds in some simple cases,
provide switches to allow disabling
-backward
-alibi
-uneven k
-dropout
-local attention
Co-authored-by: Jeremy Francis Reizenstein <bottler@users.noreply.github.com>

0658e320

21 Jan, 2024 1 commit
- Remove configure in bwd kernel launch · ea8a25ca
  Tri Dao authored Jan 21, 2024
  
  ea8a25ca
19 Jul, 2023 1 commit

Fix compile error on MSVC · 538d570c

danthe3rd authored Jul 19, 2023

See also: https://stackoverflow.com/questions/55136414/constexpr-variable-captured-inside-lambda-loses-its-constexpr-ness

538d570c

17 Jul, 2023 1 commit
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35
06 Jan, 2023 1 commit
- [Compilation] Change BOOL_SWITCH to fix Windows compilation · a1f49a2b
  Tri Dao authored Jan 06, 2023
```
Follow xFormers's DISTPATCH_BOOL. Haven't tested it on Windows.
```
  a1f49a2b
06 Dec, 2022 1 commit
- Simplify BOOL_SWITCH macro to fix compiling error on gcc 7 · 8a2ece89
  Tri Dao authored Dec 06, 2022
  
  8a2ece89
14 Oct, 2022 1 commit
- Implement attention kernel that splits the batch into two · 5badfb78
  Tri Dao authored Oct 13, 2022
  
  5badfb78
10 Jul, 2022 1 commit
- Implement for bf16 · de19de7a
  Tri Dao authored Jul 09, 2022
  
  de19de7a