Commits · 496e4f528c647aa29fb5fb8e8e989078ebe7ef6c · gaoqiong / flash-attention

21 Dec, 2022 1 commit
- Implement XPos (Sun et al.) · 496e4f52
  Tri Dao authored Dec 21, 2022
  
  496e4f52
17 Dec, 2022 1 commit
- add asserts for sin shape · ee8984d2
  Alexander Ploshkin authored Dec 17, 2022
  
  ee8984d2
16 Dec, 2022 1 commit
- fix slicing dimensions · c7c66976
  Alexander Ploshkin authored Dec 16, 2022
  
  c7c66976
15 Dec, 2022 1 commit
- Remove redundant shape asserts in rotary embeddings · 96656b93
  Alexander Ploshkin authored Dec 15, 2022
  
  96656b93
17 Nov, 2022 1 commit
- [Rotary] Customize base, support seqlen_offset · 71f674ae
  Tri Dao authored Nov 17, 2022
  
  71f674ae
14 Nov, 2022 1 commit
- Add MLP, MHA, Block, Embedding modules · d4b320b3
  Tri Dao authored Nov 13, 2022
  
  d4b320b3
05 Nov, 2022 1 commit
- Implement rotary embedding in CUDA · ca81f32e
  Tri Dao authored Nov 04, 2022
  
  ca81f32e
02 Jun, 2022 1 commit
- Rename src -> flash_attn · 5a61cb77
  Tri Dao authored Jun 01, 2022
  
  5a61cb77
29 May, 2022 1 commit
- Reorganize directories, add banner figure · 67c37795
  Tri Dao authored May 29, 2022
  
  67c37795
20 May, 2022 1 commit
- First release · 1fcbe6f0
  Tri Dao authored May 20, 2022
  
  1fcbe6f0