Commits · d562aa6354962fc48a9c76e8db7c29155c04af88 · gaoqiong / flash-attention

01 Aug, 2024 1 commit
- Sync with FA v2.6.0 to support soft capping (#13) · d562aa63
  Woosuk Kwon authored Jul 31, 2024
  
  d562aa63
19 May, 2024 2 commits
- Fix typo · 264a683d
  Woosuk Kwon authored May 19, 2024
  
  264a683d
- Use int64_t for page pointer arth · 50601bf4
  Woosuk Kwon authored May 19, 2024
  
  50601bf4
26 Mar, 2024 10 commits
- resolve page offsets absolutely not relatively · 135a1da6
  skrider authored Mar 26, 2024
  
  135a1da6
- reshape rotary sin/cos copy to align with paged KV copy · 0f5a45ea
  skrider authored Feb 26, 2024
  
  0f5a45ea
- all working except rotary embedding · bde5aec8
  skrider authored Feb 13, 2024
  
  bde5aec8
- compiles for all h but 128 · fa13c6b0
  skrider authored Feb 13, 2024
  
  fa13c6b0
- remove print statements · 347a6253
  skrider authored Feb 11, 2024
  
  347a6253
- allow small page sizes in flash api · c05b8570
  skrider authored Feb 11, 2024
  
  c05b8570
- paged copy refactor working for page size 256 · 36916777
  skrider authored Feb 11, 2024
  
  36916777
- tests passing for single page k · 175369fd
  skrider authored Feb 11, 2024
  
  175369fd
- rearrange initial offset computation · 59e76bea
  skrider authored Feb 11, 2024
  
  59e76bea
- implement kv page iteration functions · 70dd0499
  skrider authored Feb 11, 2024
  
  70dd0499
21 Jan, 2024 3 commits
- Move rotary device functions to a separate file · 395e5a0d
  Tri Dao authored Jan 20, 2024
  
  395e5a0d
- Refactor masking in fwd pass into 1 object · 66a127ae
  Tri Dao authored Jan 20, 2024
  
  66a127ae
- Change inline to __forceinline__, use __grid_constant__ param · ed4959b2
  Tri Dao authored Jan 20, 2024
  
  ed4959b2
14 Jan, 2024 1 commit
- apply_dropout now takes tensor of rowcol layout · 10dad612
  Tri Dao authored Jan 14, 2024
  
  10dad612
12 Jan, 2024 1 commit
- Simplify SmemLayoutVtransposed in kernel_traits.h · 8d1b169e
  Tri Dao authored Jan 12, 2024
  
  8d1b169e
16 Sep, 2023 1 commit
- Implement rotary embedding in flash_attn_with_kvcache · ccbb14f3
  Tri Dao authored Sep 16, 2023
  
  ccbb14f3
04 Sep, 2023 1 commit
- Implement flash_attn_with_kvcache · 37c6e054
  Tri Dao authored Sep 04, 2023
  
  37c6e054
01 Sep, 2023 1 commit
- Remove old code in utils.h (#511) · dd8a7549
  Sophia Wisdom authored Sep 01, 2023
  
  dd8a7549
13 Aug, 2023 2 commits
- Prepare for Cutlass 3.2 · dbd79237
  Tri Dao authored Aug 13, 2023
  
  dbd79237
- Update to Cutlass 3.1 · 3524e13c
  Tri Dao authored Aug 13, 2023
  
  3524e13c
17 Jul, 2023 1 commit
- FlashAttention-2 release · 4f285b35
  Tri Dao authored Jul 17, 2023
  
  4f285b35