Commits · 832385c25654dcd277199cb7fbb0847e45f99dbf · OpenDAS / FastMoE

25 Jan, 2021 7 commits
- fix mpi linking error when using nccl · 832385c2
  Rick Ho authored Jan 25, 2021
  
  832385c2
- update readme · 774071bf
  Rick Ho authored Jan 25, 2021
  
  774071bf
- Merge branch 'laekov/cudafuse' · 7e5b10b6
  Rick Ho authored Jan 25, 2021
  
  7e5b10b6
- remove redundant files · 241cdb78
  Rick Ho authored Jan 25, 2021
  
  241cdb78
- pass test · c5cfd5fb
  Rick Ho authored Jan 25, 2021
  
  c5cfd5fb
- update fmoe files · ed69591a
  Rick Ho authored Jan 25, 2021
  
  ed69591a
- move original files to examples · 0c47afbb
  Rick Ho authored Jan 25, 2021
  
  0c47afbb
17 Jan, 2021 2 commits
- overlap allreduce with computation · 94b68a3d
  Rick Ho authored Jan 17, 2021
  
  94b68a3d
- separate kernel files · 7c3e5149
  Rick Ho authored Jan 17, 2021
  
  7c3e5149
13 Jan, 2021 3 commits
- merge topk and only forward moe once · 969ef607
  Jiezhong Qiu authored Jan 13, 2021
  
  969ef607
- Merge branch 'master' of github.com:xptree/poly-xfmr · b9084e90
  Jiezhong Qiu authored Jan 13, 2021
  
  b9084e90
- import from pytorch dir · 6b38250f
  Jiezhong Qiu authored Jan 13, 2021
  
  6b38250f
12 Jan, 2021 5 commits
- fix argument count bug in moe_test.py · 46e6342e
  Rick Ho authored Jan 12, 2021
  
  46e6342e
- add nccl flag in setup.py · 3501fa41
  Rick Ho authored Jan 12, 2021
  
  3501fa41
- Merge branch 'master' of github.com:xptree/poly-xfmr · dbf55073
  Jiezhong Qiu authored Jan 12, 2021
  
  dbf55073
- update · 80a862b4
  Jiezhong Qiu authored Jan 12, 2021
  
  80a862b4
- Merge pull request #1 from xptree/laekov/multigpu · b8aa893b
  Jiezhong Qiu authored Jan 12, 2021
```
Faster MoE implementation for both single GPU and multiple GPUs
```
  b8aa893b
11 Jan, 2021 5 commits
- multi-gpu performance test · b9c28810
  Rick Ho authored Jan 11, 2021
  
  b9c28810
- distributed test weight · 76327544
  Rick Ho authored Jan 11, 2021
  
  76327544
- multi-gpu forward pass test · 864a4522
  Rick Ho authored Jan 11, 2021
  
  864a4522
- make moe run with cuda · 069cf01a
  Rick Ho authored Jan 11, 2021
  
  069cf01a
- split function file · a4f7f1da
  Rick Ho authored Jan 11, 2021
  
  a4f7f1da
10 Jan, 2021 4 commits
- global scatter gather kernels and pytorch C function · ec322e4b
  Rick Ho authored Jan 10, 2021
  
  ec322e4b
- use expert_count array instead of expert_n · 7a2ad4a1
  Rick Ho authored Jan 10, 2021
  
  7a2ad4a1
- Merge branch 'laekov/batching' into laekov/multigpu · 307e0ad9
  Rick Ho authored Jan 10, 2021
  
  307e0ad9
- remove weight input to c expert count function · 861b75c1
  Rick Ho authored Jan 10, 2021
  
  861b75c1
09 Jan, 2021 11 commits
- stream manager across multiple devices · 60b93e39
  Rick Ho authored Jan 09, 2021
  
  60b93e39
- make backward pass test · 27d8beaa
  Rick Ho authored Jan 09, 2021
  
  27d8beaa
- moe backward (cannot pass test) · 92f1774a
  Rick Ho authored Jan 09, 2021
  
  92f1774a
- modify performance test · c91dfad8
  Rick Ho authored Jan 09, 2021
  
  c91dfad8
- split operators and make forward run · 49732231
  Rick Ho authored Jan 09, 2021
  
  49732231
- update stream manager · 143e21cc
  Rick Ho authored Jan 09, 2021
  
  143e21cc
- stream manager fixed · 2565f2fa
  Rick Ho authored Jan 09, 2021
  
  2565f2fa
- fix bugs to pass test · b8a212ef
  Rick Ho authored Jan 09, 2021
  
  b8a212ef
- Merge branch 'master' into laekov/batching · bf4388c0
  Rick Ho authored Jan 09, 2021
  
  bf4388c0
- degrade to single fc fwd · 284f1424
  Rick Ho authored Jan 09, 2021
  
  284f1424
- fix last indent bug · cbd86de8
  Rick Ho authored Jan 09, 2021
  
  cbd86de8
04 Jan, 2021 1 commit
- stream manager object instead of pointer · ef83c893
  Jiezhong Qiu authored Jan 04, 2021
  
  ef83c893
03 Jan, 2021 2 commits
- fix memory leak · e52c0380
  Jiezhong Qiu authored Jan 03, 2021
  
  e52c0380
- 2 out of 32 experts · 6429fa29
  Jiezhong Qiu authored Jan 03, 2021
  
  6429fa29