Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
FastMoE
Commits
"pytorch_transformers/modeling_xlnet.py" did not exist on "4d47f4985dfb09237b6e11b5eafb0b1935f8c634"
14c0eab44920ed90611e67351bffd305429d4982
Switch branch/tag
fastmoe
fmoe
29 Jan, 2021
5 commits
fix another bug to make global moe run
· 14c0eab4
Rick Ho
authored
Jan 29, 2021
14c0eab4
fix more bugs to make the layers run in the model
· 0fea2991
Rick Ho
authored
Jan 29, 2021
0fea2991
fix python bugs
· 6900f1de
Rick Ho
authored
Jan 29, 2021
6900f1de
reconstruct fmoe nn module
· 437afda2
Rick Ho
authored
Jan 29, 2021
437afda2
split fmoe functions
· 5e0af68d
Rick Ho
authored
Jan 29, 2021
5e0af68d
28 Jan, 2021
3 commits
fix scatter/gather bug to make it correct
· 952e3135
Rick Ho
authored
Jan 28, 2021
952e3135
make test run on nccl version, but fails in correctness
· 2d250fbf
Rick Ho
authored
Jan 28, 2021
2d250fbf
single node use torch cuda expert count
· a526f438
Rick Ho
authored
Jan 28, 2021
a526f438
27 Jan, 2021
1 commit
fix expert number
· bc8e8181
Rick Ho
authored
Jan 27, 2021
bc8e8181
26 Jan, 2021
1 commit
initial version to run with megatron
· 58e949cf
Rick Ho
authored
Jan 26, 2021
58e949cf
25 Jan, 2021
3 commits
basic megatron support frame
· d0f07ff7
Rick Ho
authored
Jan 25, 2021
d0f07ff7
pass test
· c5cfd5fb
Rick Ho
authored
Jan 25, 2021
c5cfd5fb
update fmoe files
· ed69591a
Rick Ho
authored
Jan 25, 2021
ed69591a
