Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
c9861a032d6a7d044eea33b09b62f9a5d3ae7266
Switch branch/tag
flash-attention
flash_attn
ops
triton
layer_norm.py
10 Jan, 2024
1 commit
[LayerNorm] Initialize mean and rstd tensor using x.device
· c9861a03
Tri Dao
authored
Jan 09, 2024
c9861a03
05 Jan, 2024
2 commits
[LayerNorm] Rename layernorm.py -> layer_norm.py
· f5b308e2
Tri Dao
authored
Jan 05, 2024
f5b308e2
[LayerNorm] Implement parallel layer norm in Triton
· 665b55e2
Tri Dao
authored
Jan 04, 2024
665b55e2
04 Jan, 2024
1 commit
[LayerNorm] Implement rowscale in Triton layernorm
· aa5c6438
Tri Dao
authored
Jan 04, 2024
aa5c6438
20 Dec, 2023
1 commit
[LayerNorm] Implement dropout in fused residual + LN/RMSNorm
· cd089597
Tri Dao
authored
Dec 19, 2023
cd089597
01 Dec, 2023
1 commit
[LayerNorm] Implement layer_norm_linear
· 9356a1c0
Tri Dao
authored
Nov 30, 2023
9356a1c0
14 Nov, 2023
1 commit
[LayerNorm] Add postnorm residual + LayerNorm/RMSNorm in Triton
· 01771645
Tri Dao
authored
Nov 13, 2023
01771645
13 Nov, 2023
1 commit
[LayerNorm] Implement residual + LayerNorm/RMSNorm in Triton
· 79bd1a2d
Tri Dao
authored
Nov 13, 2023
79bd1a2d
