Commits · 5fb6df0e04ea5f55bdb8d3440d883015c6807a8a · gaoqiong / flash-attention

19 Dec, 2022 1 commit
- Implement BERT · 5fb6df0e
  Tri Dao authored Dec 18, 2022
  
  5fb6df0e
10 Nov, 2022 1 commit
- Remove RotaryEmbedding from FlashAttention module · 55797f32
  Tri Dao authored Nov 10, 2022
```
To avoid import error if one doesn't have rotary_emb installed
```
  55797f32
11 Sep, 2022 1 commit
- Relax assert to allow both bf16 and fp16 · 13403e81
  Tri Dao authored Sep 11, 2022
  
  13403e81
06 Sep, 2022 1 commit
- Update flash_attention.py · b410d14f
  eric-tc-wong authored Sep 06, 2022
```
Recasting query and key after rotary_emb()
```
  b410d14f
09 Aug, 2022 1 commit
- Add back need_weights in FlashMHA · 19d12610
  Tri Dao authored Aug 09, 2022
  
  19d12610
05 Aug, 2022 1 commit
- Allow headdim 128 in FlashMHA interface · 713ea302
  Tri Dao authored Aug 05, 2022
  
  713ea302
04 Jul, 2022 1 commit
- Implement cross attention · 6c3a8c65
  Tri Dao authored Jun 30, 2022
  
  6c3a8c65
02 Jun, 2022 1 commit
- Rename src -> flash_attn · 5a61cb77
  Tri Dao authored Jun 01, 2022
  
  5a61cb77
29 May, 2022 1 commit
- Reorganize directories, add banner figure · 67c37795
  Tri Dao authored May 29, 2022
  
  67c37795
26 May, 2022 1 commit
- Rename, add benchmarking script · 9dbc491a
  Tri Dao authored May 26, 2022
  
  9dbc491a
20 May, 2022 1 commit
- First release · 1fcbe6f0
  Tri Dao authored May 20, 2022
  
  1fcbe6f0