Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
23e8fa5a263d1c7122bc46a86ef32030ee7130f9
Switch branch/tag
flash-attention
tests
test_rotary.py
04 Sep, 2023
1 commit
[Rotary] Implement varlen rotary
· b28ec236
Tri Dao
authored
Sep 03, 2023
b28ec236
03 Sep, 2023
2 commits
[Rotary] Speed up rotary kernel when interleaved=True
· 1c523c1c
Tri Dao
authored
Sep 03, 2023
1c523c1c
[Rotary] Implement rotary in Triton
· 942fcbf0
Tri Dao
authored
Sep 03, 2023
942fcbf0
19 Aug, 2023
1 commit
Run isort and black on test files
· 0e8c46ae
Tri Dao
authored
Aug 18, 2023
0e8c46ae
14 Nov, 2022
1 commit
Add MLP, MHA, Block, Embedding modules
· d4b320b3
Tri Dao
authored
Nov 13, 2022
d4b320b3
05 Nov, 2022
1 commit
Implement rotary embedding in CUDA
· ca81f32e
Tri Dao
authored
Nov 04, 2022
ca81f32e
