Commits · 0c308313da8fcbef356607a7d34989e6b779e2ce · OpenDAS / FastMoE

29 Mar, 2022 2 commits
- backward bugous on grad weight · a807e2a3
  Rick Ho authored Mar 29, 2022
  
  a807e2a3
- forward pass test · 46c3722d
  Rick Ho authored Mar 29, 2022
  
  46c3722d
28 Mar, 2022 1 commit
- test for faster gate · 49b5b5d6
  Rick Ho authored Mar 28, 2022
  
  49b5b5d6
23 Nov, 2021 2 commits
- Fix missing positional argument in test_mimo.py · 3ed6b47a
  Sengxian authored Nov 23, 2021
  
  3ed6b47a
- fix and test moe with multiple input/output · 27c8c2f3
  Jiezhong Qiu authored Nov 23, 2021
  
  27c8c2f3
26 Oct, 2021 2 commits
- swipe pass test · 8a56481b
  Rick Ho authored Oct 26, 2021
  
  8a56481b
- swipe test not passing · c5cbd64b
  Rick Ho authored Oct 26, 2021
  
  c5cbd64b
10 Oct, 2021 2 commits
- fix zero test · 07a5d8ac
  Rick Ho authored Oct 10, 2021
  
  07a5d8ac
- update unit test · 33fc3aca
  Rick Ho authored Oct 10, 2021
  
  33fc3aca
30 Jul, 2021 1 commit
- update benchmark accordingly · 98584dd0
  Rick Ho authored Jul 30, 2021
  
  98584dd0
24 May, 2021 1 commit
- Update test_gates.py · 26cc37cb
  GODVIX authored May 24, 2021
  
  26cc37cb
23 May, 2021 1 commit
- mask and experts list · 28ba2d28
  Colin authored May 23, 2021
  
  28ba2d28
20 May, 2021 2 commits
- fix zero test · c931c484
  Rich Ho authored May 20, 2021
  
  c931c484
- add data_type in test ddp · 41cfe06c
  Rich Ho authored May 20, 2021
  
  41cfe06c
19 May, 2021 2 commits
- pass test on single gpu · 670d70ed
  Rick Ho authored May 19, 2021
  
  670d70ed
- update test · f804a121
  Rick Ho authored May 19, 2021
  
  f804a121
18 May, 2021 1 commit
- fix bugs to run on multiple gpus · a468db2b
  Rick Ho authored May 18, 2021
  
  a468db2b
13 May, 2021 3 commits
- test switch gate · 38b334cc
  Rich Ho authored May 13, 2021
  
  38b334cc
- gshard gate test · ddfaaf49
  Rich Ho authored May 13, 2021
  
  ddfaaf49
- add test but cannot pass · 5a0ba835
  Rick Ho authored May 13, 2021
  
  5a0ba835
29 Apr, 2021 1 commit
- Moved test into numerical. Handled different precision for half tensors · 69151519
  TiagoMAntunes authored Apr 29, 2021
  
  69151519
28 Apr, 2021 1 commit
- Added test for multiple data types in forward and backward pass · f5408e3c
  TiagoMAntunes authored Apr 28, 2021
  
  f5408e3c
26 Apr, 2021 2 commits
- fix zero gate and constant gate · 450549a4
  Rick Ho authored Apr 26, 2021
  
  450549a4
- add gshard and switch gate with loss · 4c90e6e8
  Rick Ho authored Apr 26, 2021
  
  4c90e6e8
23 Mar, 2021 1 commit
- fix tests after updating megatron · 6868ed2a
  Rick Ho authored Mar 24, 2021
  
  6868ed2a
22 Mar, 2021 1 commit
- Add gshard and noisy gate balance strategy · 89d6c794
  Sengxian authored Mar 22, 2021
  
  89d6c794
13 Mar, 2021 1 commit
- manually broadcast nccl unique id · 43af1522
  Rick Ho authored Mar 13, 2021
  
  43af1522
09 Mar, 2021 1 commit
- Format using black · 4d48209d
  Sengxian authored Mar 09, 2021
  
  4d48209d
08 Mar, 2021 1 commit
- fix numerical issue in tests and typo · 527a8cc9
  Rick Ho authored Mar 08, 2021
  
  527a8cc9
22 Feb, 2021 3 commits
- fix unpack bug · 092c8d67
  Sengxian authored Feb 22, 2021
  
  092c8d67
- customized top_k and add test for localddp · f39f411a
  Sengxian authored Feb 22, 2021
  
  f39f411a
- add inspection of input.grad in tests · 5cb4e63c
  Rick Ho authored Feb 22, 2021
  
  5cb4e63c
21 Feb, 2021 3 commits
- test bias grad · e36c3c4c
  Jiezhong Qiu authored Feb 21, 2021
  
  e36c3c4c
- new test structure according to new expert_fn structure · 6acc3e41
  Rick Ho authored Feb 21, 2021
  
  6acc3e41
- test bias, dp still not passed · a88d1124
  Jiezhong Qiu authored Feb 21, 2021
  
  a88d1124
09 Feb, 2021 1 commit
- Skip test when there are no enough gpu · 7466180f
  Sengxian authored Feb 09, 2021
  
  7466180f
08 Feb, 2021 4 commits
- Add model parallel test for FMoE with ddp · dad99892
  Sengxian authored Feb 08, 2021
  
  dad99892
- Seperate ddp test from test_numerical · 06e75b3a
  Sengxian authored Feb 08, 2021
  
  06e75b3a
- adapt benchmark to new moe module · 101b847c
  Rick Ho authored Feb 08, 2021
  
  101b847c
- Add DataParallel test for FMoE · 34477955
  Sengxian authored Feb 08, 2021
  
  34477955