Commits · 956d3aef0126cfff9db313d68266e85bf9d806dc · OpenDAS / FastMoE

26 Apr, 2021 2 commits
- fix stream manager · 956d3aef
  Rick Ho authored Apr 26, 2021
  
  956d3aef
- reconstruct fmoe cuda code · bb3c8966
  Rick Ho authored Apr 26, 2021
  
  bb3c8966
22 Mar, 2021 1 commit
- Add gshard and noisy gate balance strategy · 89d6c794
  Sengxian authored Mar 22, 2021
  
  89d6c794
13 Mar, 2021 1 commit
- manually broadcast nccl unique id · 43af1522
  Rick Ho authored Mar 13, 2021
  
  43af1522
04 Mar, 2021 1 commit
- remove dependency on cuda sample repo · 7d695acb
  Rick Ho authored Mar 04, 2021
  
  7d695acb
07 Feb, 2021 1 commit
- strong compatibility to different python and pytorch versions · 103343ca
  Rick Ho authored Feb 07, 2021
  
  103343ca
04 Feb, 2021 2 commits
- fix pytorch header compilation bug · 79ccb7b6
  Rick Ho authored Feb 04, 2021
  
  79ccb7b6
- adapt with pytorch 1.8.0 (deprecated 1.6.0) · 15f98a10
  Rick Ho authored Feb 04, 2021
  
  15f98a10
03 Feb, 2021 1 commit
- fix ensure device index bug · ea66e5e5
  Rick Ho authored Feb 03, 2021
  
  ea66e5e5
01 Feb, 2021 1 commit
- swap local scatter and gather kernel functions · d2039fc7
  Rick Ho authored Feb 01, 2021
  
  d2039fc7
29 Jan, 2021 1 commit
- scatter gather kernel support for non-equal shapes and fix tests · 72e9bc9e
  Rick Ho authored Jan 29, 2021
  
  72e9bc9e
28 Jan, 2021 4 commits
- support fp16 · 49c97411
  Rick Ho authored Jan 28, 2021
  
  49c97411
- make test run on nccl version, but fails in correctness · 2d250fbf
  Rick Ho authored Jan 28, 2021
  
  2d250fbf
- hack nccl of pytorch · 293eef6d
  Rick Ho authored Jan 28, 2021
  
  293eef6d
- single node use torch cuda expert count · a526f438
  Rick Ho authored Jan 28, 2021
  
  a526f438
25 Jan, 2021 2 commits
- remove redundant files · 241cdb78
  Rick Ho authored Jan 25, 2021
  
  241cdb78
- move original files to examples · 0c47afbb
  Rick Ho authored Jan 25, 2021
  
  0c47afbb