Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
flash-attention
Commits
4d87e4d875077ad9efd25030efa4ab0ba92c19e1
Switch branch/tag
flash-attention
flash_attn
modules
block.py
22 Mar, 2023
1 commit
Implement GPT-J
· 4d87e4d8
Tri Dao
authored
Mar 22, 2023
4d87e4d8
18 Jan, 2023
1 commit
[FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP
· 88173a1a
Tri Dao
authored
Jan 17, 2023
88173a1a
16 Jan, 2023
3 commits
[ViT] Support timm checkpoint, add tests
· 780e8eea
Tri Dao
authored
Jan 16, 2023
780e8eea
[ViT] Fix extra norm_0, use new LN order in Block
· ef085cfc
Tri Dao
authored
Jan 15, 2023
ef085cfc
Reorder LN in Block, support OPT
· ff34123b
Tri Dao
authored
Jan 15, 2023
ff34123b
07 Jan, 2023
1 commit
[TP] Implement TensorParallel without sequence parallel
· 93383bd5
Tri Dao
authored
Jan 07, 2023
93383bd5
25 Dec, 2022
1 commit
Implement Tensor Parallel for transformer Block
· a8cfe515
Tri Dao
authored
Dec 25, 2022
a8cfe515
19 Dec, 2022
1 commit
Implement BERT
· 5fb6df0e
Tri Dao
authored
Dec 18, 2022
5fb6df0e
14 Nov, 2022
1 commit
Add MLP, MHA, Block, Embedding modules
· d4b320b3
Tri Dao
authored
Nov 13, 2022
d4b320b3