Commits · abbc1311731867310635f9edc2a9ec18317c8c48 · gaoqiong / flash-attention

05 Jan, 2024 1 commit
- [LayerNorm] Switch from CUDA to Triton implementation · abbc1311
  Tri Dao authored Jan 05, 2024
  
  abbc1311
18 Aug, 2023 3 commits
- Run isort and black on python files · f1a73d07
  Tri Dao authored Aug 18, 2023
  
  f1a73d07
- [ViT] Run black on vit.py · ada4710d
  Tri Dao authored Aug 17, 2023
  
  ada4710d
- [ViT] Minor fix so it runs · a81900d4
  Tri Dao authored Aug 17, 2023
  
  a81900d4
18 Jan, 2023 1 commit
- [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP · 88173a1a
  Tri Dao authored Jan 17, 2023
  
  88173a1a
16 Jan, 2023 2 commits
- [ViT] Support timm checkpoint, add tests · 780e8eea
  Tri Dao authored Jan 16, 2023
  
  780e8eea
- [ViT] Fix extra norm_0, use new LN order in Block · ef085cfc
  Tri Dao authored Jan 15, 2023
  
  ef085cfc
23 Nov, 2022 1 commit
- [ViT] Use dropout_add_ln for the 1st layer norm · 1feb9426
  Tri Dao authored Nov 23, 2022
  
  1feb9426
14 Nov, 2022 1 commit
- Add GPT and ViT models · 2e33fc8e
  Tri Dao authored Nov 13, 2022
  
  2e33fc8e