README.md 171 Bytes
Newer Older
q.yao's avatar
q.yao committed
1
2
3
4
5
6
7
#Flash Attention 2

This is flash attention2 implementation modified from https://github.com/Dao-AILab/flash-attention

- remove dropout
- remove backward
- cutlass 3.1.0