Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
FastMoE
Commits
cdc140f189ba1bd678790c6ac4d3fbb038cd685b
Switch branch/tag
fastmoe
fmoe
gates
gshard_gate.py
04 Aug, 2022
1 commit
fix GshardGate top1_idx
· 5f8e3999
Fragile-azalea
authored
Aug 04, 2022
5f8e3999
28 Mar, 2022
1 commit
Fix GShardGate random_routing
· cfd30236
zms1999
authored
Mar 28, 2022
cfd30236
29 May, 2021
1 commit
fix bugs to run megatron with gshard gate
· fa5f45f0
Rick Ho
authored
May 29, 2021
fa5f45f0
24 May, 2021
1 commit
add random routing in gshard gate
· e58e7b3b
Rich Ho
authored
May 24, 2021
e58e7b3b
18 May, 2021
1 commit
fix bugs to run on multiple gpus
· a468db2b
Rick Ho
authored
May 18, 2021
a468db2b
13 May, 2021
3 commits
test switch gate
· 38b334cc
Rich Ho
authored
May 13, 2021
38b334cc
gshard gate test
· ddfaaf49
Rich Ho
authored
May 13, 2021
ddfaaf49
add test but cannot pass
· 5a0ba835
Rick Ho
authored
May 13, 2021
5a0ba835
27 Apr, 2021
2 commits
gshard prune gate cuda code and test
· 56cb8c15
Rick Ho
authored
Apr 27, 2021
56cb8c15
balancing cuda code
· 1aced6d8
Rick Ho
authored
Apr 27, 2021
1aced6d8
26 Apr, 2021
1 commit
add gshard and switch gate with loss
· 4c90e6e8
Rick Ho
authored
Apr 26, 2021
4c90e6e8
