Commits · ffc8682dd53f6440b9af214166e7bf27a51d2232 · gaoqiong / flash-attention

24 Jan, 2024 1 commit
- Add benchmarking code for Alibi (from Sanghun Cho) · ffc8682d
  Tri Dao authored Jan 23, 2024
  
  ffc8682d
27 Nov, 2023 1 commit
- Fix performance regression with causal · b4bf9cc1
  Tri Dao authored Nov 26, 2023
  
  b4bf9cc1
25 Aug, 2023 2 commits
- add benchmark for xformers fa2 wrapper (#492) · b4b6e903
  Aman Gupta Karmani authored Aug 25, 2023
  
  b4b6e903
- Change causal mask to be aligned to bottom-right instead of top-left · 9e5e8bc9
  Tri Dao authored Aug 21, 2023
  
  9e5e8bc9
28 Jul, 2023 1 commit
- [Benchmark] Add script to benchmark FlashAttention · 60499abc
  Tri Dao authored Jul 28, 2023
  
  60499abc
17 Jul, 2023 1 commit
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35
22 Mar, 2023 2 commits
- [Triton] Fix benchmark_causal.py · 4360cfc6
  Tri Dao authored Mar 22, 2023
  
  4360cfc6
- [Triton] Fix benchmark_causal, mention Triton version · 5d079fdd
  Tri Dao authored Mar 22, 2023
  
  5d079fdd
31 Oct, 2022 1 commit
- Implement FlashAttention in Triton · b0c0db81
  Tri Dao authored Oct 30, 2022
  
  b0c0db81
24 Oct, 2022 2 commits
- Add Megatron attention implementation for benchmarking · ed553e92
  Tri Dao authored Oct 23, 2022
  
  ed553e92
- Add Triton implementation for benchmarking · 50ca2348
  Tri Dao authored Oct 23, 2022
  
  50ca2348
23 Oct, 2022 1 commit
- Move benchmark utils, support AMP · fb88e5e4
  Tri Dao authored Oct 23, 2022
  
  fb88e5e4
04 Jul, 2022 1 commit
- Implement cross attention · 6c3a8c65
  Tri Dao authored Jun 30, 2022
  
  6c3a8c65
02 Jun, 2022 1 commit
- Rename src -> flash_attn · 5a61cb77
  Tri Dao authored Jun 01, 2022
  
  5a61cb77
29 May, 2022 1 commit
- Reorganize directories, add banner figure · 67c37795
  Tri Dao authored May 29, 2022
  
  67c37795
26 May, 2022 1 commit
- Rename, add benchmarking script · 9dbc491a
  Tri Dao authored May 26, 2022
  
  9dbc491a