Commits · 069cf01a3cc970b8317889e647b910192da4e186 · OpenDAS / FastMoE

11 Jan, 2021 1 commit
- make moe run with cuda · 069cf01a
  Rick Ho authored Jan 11, 2021
  
  069cf01a
10 Jan, 2021 3 commits
- global scatter gather kernels and pytorch C function · ec322e4b
  Rick Ho authored Jan 10, 2021
  
  ec322e4b
- use expert_count array instead of expert_n · 7a2ad4a1
  Rick Ho authored Jan 10, 2021
  
  7a2ad4a1
- remove weight input to c expert count function · 861b75c1
  Rick Ho authored Jan 10, 2021
  
  861b75c1
09 Jan, 2021 9 commits
- stream manager across multiple devices · 60b93e39
  Rick Ho authored Jan 09, 2021
  
  60b93e39
- make backward pass test · 27d8beaa
  Rick Ho authored Jan 09, 2021
  
  27d8beaa
- moe backward (cannot pass test) · 92f1774a
  Rick Ho authored Jan 09, 2021
  
  92f1774a
- split operators and make forward run · 49732231
  Rick Ho authored Jan 09, 2021
  
  49732231
- update stream manager · 143e21cc
  Rick Ho authored Jan 09, 2021
  
  143e21cc
- stream manager fixed · 2565f2fa
  Rick Ho authored Jan 09, 2021
  
  2565f2fa
- fix bugs to pass test · b8a212ef
  Rick Ho authored Jan 09, 2021
  
  b8a212ef
- degrade to single fc fwd · 284f1424
  Rick Ho authored Jan 09, 2021
  
  284f1424
- fix last indent bug · cbd86de8
  Rick Ho authored Jan 09, 2021
  
  cbd86de8
04 Jan, 2021 1 commit
- stream manager object instead of pointer · ef83c893
  Jiezhong Qiu authored Jan 04, 2021
  
  ef83c893
03 Jan, 2021 1 commit
- cudafree malloced memory · 1bde1726
  Jiezhong Qiu authored Jan 03, 2021
  
  1bde1726
02 Jan, 2021 2 commits
- set device according to input · 046455a8
  Jiezhong Qiu authored Jan 03, 2021
  
  046455a8
- add moe debug flag · d036918c
  Jiezhong Qiu authored Jan 02, 2021
  
  d036918c
31 Dec, 2020 5 commits
- general support for profiling · 706f0cfd
  Rick Ho authored Jan 01, 2021
  
  706f0cfd
- make it run · 881b10c2
  Rick Ho authored Jan 01, 2021
  
  881b10c2
- fix ptr correctness · 691e92e1
  Rick Ho authored Jan 01, 2021
  
  691e92e1
- fix output bug · 7e949a62
  Rick Ho authored Dec 31, 2020
  
  7e949a62
- nccl runs with 2 gpus · 4cb75d42
  Rick Ho authored Dec 31, 2020
  
  4cb75d42
30 Dec, 2020 7 commits
- manual batched scatter and gather kernels · d690c7b2
  Rick Ho authored Dec 30, 2020
  
  d690c7b2
- two-level matmul fix transpose · 35addec6
  Rick Ho authored Dec 30, 2020
  
  35addec6
- limit max streams · bf60a846
  Rick Ho authored Dec 30, 2020
  
  bf60a846
- naive memcpy batch with buffer · 9cae3294
  Rick Ho authored Dec 30, 2020
  
  9cae3294
- tide up C code · 8cff6ad7
  Rick Ho authored Dec 30, 2020
  
  8cff6ad7
- sync every stream · 560d3f1b
  Jiezhong Qiu authored Dec 30, 2020
  
  560d3f1b
- update · 5d076dcf
  Jiezhong Qiu authored Dec 30, 2020
  
  5d076dcf
29 Dec, 2020 6 commits
- update · 0ab605cc
  Jiezhong Qiu authored Dec 29, 2020
  
  0ab605cc
- update · b83ac1a5
  Jiezhong Qiu authored Dec 29, 2020
  
  b83ac1a5
- update · 32e35812
  Jiezhong Qiu authored Dec 29, 2020
  
  32e35812
- debuging · d4dd2a6c
  Jiezhong Qiu authored Dec 29, 2020
  
  d4dd2a6c
- update · 93291a7e
  Jiezhong Qiu authored Dec 29, 2020
  
  93291a7e
- moe forward and backward · 84bdd842
  Jiezhong Qiu authored Dec 29, 2020
  
  84bdd842
23 Dec, 2020 3 commits
- update · 1704dc36
  Jiezhong Qiu authored Dec 23, 2020
  
  1704dc36
- topk=1 · eb47044a
  Jiezhong Qiu authored Dec 23, 2020
  
  eb47044a
- updarte · 3a458fa7
  Jiezhong Qiu authored Dec 23, 2020
  
  3a458fa7
19 Dec, 2020 1 commit
- update · 707652bc
  Jiezhong Qiu authored Dec 19, 2020
  
  707652bc
18 Dec, 2020 1 commit
- 0.4T Flops · 74cc6ec2
  Jiezhong Qiu authored Dec 18, 2020
  
  74cc6ec2