hopper/flash_attn_interface.py · dfe1a59e4bcd932248f1e72b7c39cb2f80c18d2e · gaoqiong / flash-attention

Ying Zhang authored Jul 22, 2024



* fwd var-seq-len

* fixes

* benchmark

* fixes

---------
Co-authored-by: Tri Dao <tridao@users.noreply.github.com>

dfe1a59e

flash_attn_interface.py 11.2 KB