Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
4b661a569dc0e476b07a0ac13a892fc8d120b3b0
Switch branch/tag
flash-attention
flash_attn
models
vit.py
18 Jan, 2023
1 commit
[FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP
· 88173a1a
Tri Dao
authored
Jan 17, 2023
88173a1a
16 Jan, 2023
2 commits
[ViT] Support timm checkpoint, add tests
· 780e8eea
Tri Dao
authored
Jan 16, 2023
780e8eea
[ViT] Fix extra norm_0, use new LN order in Block
· ef085cfc
Tri Dao
authored
Jan 15, 2023
ef085cfc
23 Nov, 2022
1 commit
[ViT] Use dropout_add_ln for the 1st layer norm
· 1feb9426
Tri Dao
authored
Nov 23, 2022
1feb9426
14 Nov, 2022
1 commit
Add GPT and ViT models
· 2e33fc8e
Tri Dao
authored
Nov 13, 2022
2e33fc8e
