Commits · 7f67966cc742029c0a93755a20c583667836f9d5 · gaoqiong / flash-attention

11 Jul, 2024 1 commit
- FA3 initial code release · 7f67966c
  Tri Dao authored Jul 11, 2024
  
  7f67966c
27 Jun, 2024 1 commit

Support unpadded LSE layout (#970) · f816dee6

Grigory Sizov authored Jun 27, 2024



* Support unpadded LSE layout.
Co-authored-by: Xinfeng Xie <xfxie.ceca@gmail.com>
Co-authored-by: Jianyu Huang <hjyahead@gmail.com>

* Cleanup

* Fix unpadded LSE on split-kv path

* Fix formatting and comments

* Fix inline vs forceinline

---------
Co-authored-by: Xinfeng Xie <xfxie.ceca@gmail.com>
Co-authored-by: Jianyu Huang <hjyahead@gmail.com>

f816dee6

26 May, 2024 1 commit
- Update to Cutlass 3.5 · d732be1e
  Tri Dao authored May 26, 2024
  
  d732be1e
15 Jan, 2024 1 commit
- Move bwd preprocess kernels to a separate file · 5aca153d
  Tri Dao authored Jan 14, 2024
  
  5aca153d