Commits · ada4710d70c7d6a657c6725614726219cd1b4efc · gaoqiong / flash-attention

18 Aug, 2023 2 commits
- [ViT] Run black on vit.py · ada4710d
  Tri Dao authored Aug 17, 2023
  
  ada4710d
- [ViT] Minor fix so it runs · a81900d4
  Tri Dao authored Aug 17, 2023
  
  a81900d4
18 Jan, 2023 1 commit
- [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP · 88173a1a
  Tri Dao authored Jan 17, 2023
  
  88173a1a
16 Jan, 2023 2 commits
- [ViT] Support timm checkpoint, add tests · 780e8eea
  Tri Dao authored Jan 16, 2023
  
  780e8eea
- [ViT] Fix extra norm_0, use new LN order in Block · ef085cfc
  Tri Dao authored Jan 15, 2023
  
  ef085cfc
23 Nov, 2022 1 commit
- [ViT] Use dropout_add_ln for the 1st layer norm · 1feb9426
  Tri Dao authored Nov 23, 2022
  
  1feb9426
14 Nov, 2022 1 commit
- Add GPT and ViT models · 2e33fc8e
  Tri Dao authored Nov 13, 2022
  
  2e33fc8e