Commits · b0c0db81f64cf8d2adc8d5fd962a49cd3e9396a4 · gaoqiong / flash-attention

31 Oct, 2022 1 commit
- Implement FlashAttention in Triton · b0c0db81
  Tri Dao authored Oct 30, 2022
  
  b0c0db81
24 Oct, 2022 2 commits
- Add Megatron attention implementation for benchmarking · ed553e92
  Tri Dao authored Oct 23, 2022
  
  ed553e92
- Add Triton implementation for benchmarking · 50ca2348
  Tri Dao authored Oct 23, 2022
  
  50ca2348
23 Oct, 2022 1 commit
- Move benchmark utils, support AMP · fb88e5e4
  Tri Dao authored Oct 23, 2022
  
  fb88e5e4
04 Jul, 2022 1 commit
- Implement cross attention · 6c3a8c65
  Tri Dao authored Jun 30, 2022
  
  6c3a8c65
02 Jun, 2022 1 commit
- Rename src -> flash_attn · 5a61cb77
  Tri Dao authored Jun 01, 2022
  
  5a61cb77
29 May, 2022 1 commit
- Reorganize directories, add banner figure · 67c37795
  Tri Dao authored May 29, 2022
  
  67c37795
26 May, 2022 1 commit
- Rename, add benchmarking script · 9dbc491a
  Tri Dao authored May 26, 2022
  
  9dbc491a