Commits · 5018ac6ac531aabdb05c8af1ba3d98a2235bdbde · gaoqiong / flash-attention

27 Jun, 2024 1 commit

Support unpadded LSE layout (#970) · f816dee6

Grigory Sizov authored Jun 27, 2024



* Support unpadded LSE layout.
Co-authored-by: Xinfeng Xie <xfxie.ceca@gmail.com>
Co-authored-by: Jianyu Huang <hjyahead@gmail.com>

* Cleanup

* Fix unpadded LSE on split-kv path

* Fix formatting and comments

* Fix inline vs forceinline

---------
Co-authored-by: Xinfeng Xie <xfxie.ceca@gmail.com>
Co-authored-by: Jianyu Huang <hjyahead@gmail.com>

f816dee6

26 May, 2024 1 commit
- Update to Cutlass 3.5 · d732be1e
  Tri Dao authored May 26, 2024
  
  d732be1e
15 Jan, 2024 1 commit
- Move bwd preprocess kernels to a separate file · 5aca153d
  Tri Dao authored Jan 14, 2024
  
  5aca153d