Commits · ed4959b2ebb92c0fb11aaef04f6e16d231ccea24 · gaoqiong / flash-attention

21 Jan, 2024 1 commit
- Change inline to __forceinline__, use __grid_constant__ param · ed4959b2
  Tri Dao authored Jan 20, 2024
  
  ed4959b2
27 Nov, 2023 1 commit
- Allow varlen_fwd to take optional seqused_k (#647) · ce3e7280
  Jeremy Reizenstein authored Nov 27, 2023
```
Co-authored-by: bottler <bottler@users.noreply.github.com>
```
  ce3e7280
11 Sep, 2023 1 commit
- Swap seqlen_q and nheads for MQA to speed it up (h/t Daniel Haziza) · ee77b931
  Tri Dao authored Sep 10, 2023
  
  ee77b931
04 Sep, 2023 1 commit
- Implement flash_attn_with_kvcache · 37c6e054
  Tri Dao authored Sep 04, 2023
  
  37c6e054
25 Aug, 2023 1 commit
- Change causal mask to be aligned to bottom-right instead of top-left · 9e5e8bc9
  Tri Dao authored Aug 21, 2023
  
  9e5e8bc9
17 Jul, 2023 1 commit
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35