Commits · baae8fb90db1d04b4e4ce9d00a50696d5efbe060 · OpenDAS / FastMoE

19 May, 2021 2 commits
- pass test on single gpu · 670d70ed
  Rick Ho authored May 19, 2021
  
  670d70ed
- update test · f804a121
  Rick Ho authored May 19, 2021
  
  f804a121
13 May, 2021 1 commit
- gshard gate test · ddfaaf49
  Rich Ho authored May 13, 2021
  
  ddfaaf49
09 Mar, 2021 1 commit
- Format using black · 4d48209d
  Sengxian authored Mar 09, 2021
  
  4d48209d
21 Feb, 2021 1 commit
- test bias, dp still not passed · a88d1124
  Jiezhong Qiu authored Feb 21, 2021
  
  a88d1124
08 Feb, 2021 3 commits
- adapt benchmark to new moe module · 101b847c
  Rick Ho authored Feb 08, 2021
  
  101b847c
- Add test for arbitrary expert in FMoE · 5ead59db
  Sengxian authored Feb 08, 2021
  
  5ead59db
- a stronger benchmark · d2678111
  Rick Ho authored Feb 08, 2021
  
  d2678111
07 Feb, 2021 1 commit
- Add test for FMoE · fc78d5c3
  Sengxian authored Feb 07, 2021
  
  fc78d5c3
01 Feb, 2021 1 commit
- complete test for reconstruction · 22e1eb45
  Rick Ho authored Feb 01, 2021
  
  22e1eb45
29 Jan, 2021 1 commit
- reconstruct fmoe nn module · 437afda2
  Rick Ho authored Jan 29, 2021
  
  437afda2
27 Jan, 2021 1 commit
- fix expert number · bc8e8181
  Rick Ho authored Jan 27, 2021
  
  bc8e8181
26 Jan, 2021 1 commit
- initial version to run with megatron · 58e949cf
  Rick Ho authored Jan 26, 2021
  
  58e949cf
25 Jan, 2021 3 commits
- basic megatron support frame · d0f07ff7
  Rick Ho authored Jan 25, 2021
  
  d0f07ff7
- pass test · c5cfd5fb
  Rick Ho authored Jan 25, 2021
  
  c5cfd5fb
- update fmoe files · ed69591a
  Rick Ho authored Jan 25, 2021
  
  ed69591a