Commits · 1aced6d8d2b3ae0a8b76e3ba18ed34de56354aaa · OpenDAS / FastMoE

27 Apr, 2021 1 commit
- balancing cuda code · 1aced6d8
  Rick Ho authored Apr 27, 2021
  
  1aced6d8
26 Apr, 2021 1 commit
- reconstruct fmoe cuda code · bb3c8966
  Rick Ho authored Apr 26, 2021
  
  bb3c8966
13 Mar, 2021 1 commit
- fix lint · 3b82e379
  Rick Ho authored Mar 13, 2021
  
  3b82e379
09 Mar, 2021 1 commit
- Format using black · 4d48209d
  Sengxian authored Mar 09, 2021
  
  4d48209d
23 Feb, 2021 1 commit
- Fix input grad in mp group · 704092b1
  Sengxian authored Feb 23, 2021
  
  704092b1
05 Feb, 2021 3 commits
- do not require comm in non-nccl environment · 5e9bb2e9
  Rick Ho authored Feb 05, 2021
  
  5e9bb2e9
- pass pylint · f2040d9f
  Rick Ho authored Feb 05, 2021
  
  f2040d9f
- support multiple pytorch versions prviate apis · bf2fd0c0
  Rick Ho authored Feb 05, 2021
  
  bf2fd0c0
04 Feb, 2021 3 commits
- adapt with pytorch 1.8.0 (deprecated 1.6.0) · 15f98a10
  Rick Ho authored Feb 04, 2021
  
  15f98a10
- setup pylint and write docs for functions · 585604fe
  Rick Ho authored Feb 04, 2021
  
  585604fe
- fix no grad after all-gather bug · 56c1bd63
  Rick Ho authored Feb 04, 2021
  
  56c1bd63
02 Feb, 2021 1 commit
- Format using black and add model_parallel_rank · fdbac1df
  Sengxian authored Feb 02, 2021
  
  fdbac1df
01 Feb, 2021 3 commits
- split more tests · 01d9b418
  Rick Ho authored Feb 01, 2021
  
  01d9b418
- complete test for reconstruction · 22e1eb45
  Rick Ho authored Feb 01, 2021
  
  22e1eb45
- swap local scatter and gather kernel functions · d2039fc7
  Rick Ho authored Feb 01, 2021
  
  d2039fc7
29 Jan, 2021 4 commits
- fix another bug to make global moe run · 14c0eab4
  Rick Ho authored Jan 29, 2021
  
  14c0eab4
- fix more bugs to make the layers run in the model · 0fea2991
  Rick Ho authored Jan 29, 2021
  
  0fea2991
- fix python bugs · 6900f1de
  Rick Ho authored Jan 29, 2021
  
  6900f1de
- split fmoe functions · 5e0af68d
  Rick Ho authored Jan 29, 2021
  
  5e0af68d