FlashAttention-2 release

4f285b35 · Tri Dao · 6d48e14a · 4f285b35 · 4f285b35 · 4f285b35
Commit 4f285b35 authored Jul 17, 2023 by Tri Dao
10 changed files
--- a/csrc/flash_attn/src/static_switch.h
+++ b/csrc/flash_attn/src/static_switch.h
--- a/csrc/flash_attn/src/utils.h
+++ b/csrc/flash_attn/src/utils.h
--- a/flash_attn/__init__.py
+++ b/flash_attn/__init__.py
--- a/flash_attn/flash_attention.py
+++ b/flash_attn/flash_attention.py
--- a/flash_attn/flash_attn_interface.py
+++ b/flash_attn/flash_attn_interface.py
--- a/flash_attn/modules/block.py
+++ b/flash_attn/modules/block.py
--- a/flash_attn/modules/mha.py
+++ b/flash_attn/modules/mha.py
--- a/setup.py
+++ b/setup.py
--- a/tests/test_flash_attn.py
+++ b/tests/test_flash_attn.py
--- a/training/Dockerfile
+++ b/training/Dockerfile