Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
780e8eeabb84fe3f41e8244f04521743b032ba35
Switch branch/tag
flash-attention
flash_attn
models
vit.py
16 Jan, 2023
2 commits
[ViT] Support timm checkpoint, add tests
· 780e8eea
Tri Dao
authored
Jan 16, 2023
780e8eea
[ViT] Fix extra norm_0, use new LN order in Block
· ef085cfc
Tri Dao
authored
Jan 15, 2023
ef085cfc
23 Nov, 2022
1 commit
[ViT] Use dropout_add_ln for the 1st layer norm
· 1feb9426
Tri Dao
authored
Nov 23, 2022
1feb9426
14 Nov, 2022
1 commit
Add GPT and ViT models
· 2e33fc8e
Tri Dao
authored
Nov 13, 2022
2e33fc8e
