Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
009a3e71ece11b2ec20629883f7d66212db52c7d
Switch branch/tag
flash-attention
tests
ops
18 Jan, 2023
1 commit
[FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP
· 88173a1a
Tri Dao
authored
Jan 17, 2023
88173a1a
07 Jan, 2023
2 commits
[TP] Implement TensorParallel without sequence parallel
· 93383bd5
Tri Dao
authored
Jan 07, 2023
93383bd5
[LayerNorm] Implement RMS Norm
· 6738d947
Tri Dao
authored
Jan 06, 2023
6738d947
24 Dec, 2022
1 commit
Implement TensorParallel for FusedDense and FusedDenseGeluDense
· 226a1b72
Tri Dao
authored
Dec 23, 2022
226a1b72
23 Dec, 2022
1 commit
Simplify FusedDense
· e68ebbe8
Tri Dao
authored
Dec 22, 2022
e68ebbe8
13 Dec, 2022
1 commit
[LayerNorm] Support taking subset of input or subset of output
· 5db33051
Tri Dao
authored
Dec 12, 2022
5db33051
11 Dec, 2022
1 commit
[LayerNorm] Fuse LayerScale
· ae137ed1
Tri Dao
authored
Dec 10, 2022
ae137ed1
09 Dec, 2022
1 commit
[LayerNorm] Support all dimensions up to 6k (if divisible by 8)
· 8c6609ae
Tri Dao
authored
Dec 08, 2022
8c6609ae
14 Nov, 2022
1 commit
Add fused_dense and dropout_add_layernorm CUDA extensions
· fa6d1ce4
Tri Dao
authored
Nov 13, 2022
fa6d1ce4
