GitLab

This reverts commit 1899c970.

* adding files for fp8 changes.

* removed contiguous check.

* enable all tests except odd-seq-lengths, where it crashes now.

* undid clang formatting.

* change to correct tile size for headdim=128.

* fixed odd-seq-len-k.

* minor formatting.

* minor reformatting.

---------
Co-authored-by: Tri Dao <tridao@users.noreply.github.com>

Library name to import is `flash_attn_interface`, which matches the
test.

* fwd var-seq-len

* fixes

* benchmark

* fixes

---------
Co-authored-by: Tri Dao <tridao@users.noreply.github.com>