Commits · 36587c01cb4390de0a590b2131e3fcc4859ba09c · gaoqiong / flash-attention

19 Mar, 2024 1 commit
- [LayerNorm] Update layer_norm_linear · 36587c01
  Tri Dao authored Mar 18, 2024
  
  36587c01
23 Jan, 2024 1 commit
- [LayerNorm] Don't exit early in the backward pass (fix #781) · bdcae547
  Tri Dao authored Jan 22, 2024
  
  bdcae547
10 Jan, 2024 1 commit
- [LayerNorm] Initialize mean and rstd tensor using x.device · c9861a03
  Tri Dao authored Jan 09, 2024
  
  c9861a03
05 Jan, 2024 2 commits
- [LayerNorm] Rename layernorm.py -> layer_norm.py · f5b308e2
  Tri Dao authored Jan 05, 2024
  
  f5b308e2
- [LayerNorm] Implement parallel layer norm in Triton · 665b55e2
  Tri Dao authored Jan 04, 2024
  
  665b55e2
04 Jan, 2024 1 commit
- [LayerNorm] Implement rowscale in Triton layernorm · aa5c6438
  Tri Dao authored Jan 04, 2024
  
  aa5c6438
20 Dec, 2023 1 commit
- [LayerNorm] Implement dropout in fused residual + LN/RMSNorm · cd089597
  Tri Dao authored Dec 19, 2023
  
  cd089597
01 Dec, 2023 1 commit
- [LayerNorm] Implement layer_norm_linear · 9356a1c0
  Tri Dao authored Nov 30, 2023
  
  9356a1c0
14 Nov, 2023 1 commit
- [LayerNorm] Add postnorm residual + LayerNorm/RMSNorm in Triton · 01771645
  Tri Dao authored Nov 13, 2023
  
  01771645
13 Nov, 2023 1 commit
- [LayerNorm] Implement residual + LayerNorm/RMSNorm in Triton · 79bd1a2d
  Tri Dao authored Nov 13, 2023
  
  79bd1a2d