Commits · 3c2a59790566cd03ffd869301b49f9997bec9937 · OpenDAS / FastMoE

22 Mar, 2021 1 commit
- Add gshard and noisy gate balance strategy · 89d6c794
  Sengxian authored Mar 22, 2021
  
  89d6c794
13 Mar, 2021 1 commit
- manually broadcast nccl unique id · 43af1522
  Rick Ho authored Mar 13, 2021
  
  43af1522
09 Mar, 2021 1 commit
- Format using black · 4d48209d
  Sengxian authored Mar 09, 2021
  
  4d48209d
22 Feb, 2021 1 commit
- add inspection of input.grad in tests · 5cb4e63c
  Rick Ho authored Feb 22, 2021
  
  5cb4e63c
08 Feb, 2021 2 commits
- adapt benchmark to new moe module · 101b847c
  Rick Ho authored Feb 08, 2021
  
  101b847c
- a stronger benchmark · d2678111
  Rick Ho authored Feb 08, 2021
  
  d2678111