Commits · 0a6becae423edf6462ccb73159bdc2f6d211ffd5 · OpenDAS / FastMoE

11 Sep, 2023 1 commit
- fix tests · 0a6becae
  Rick Ho authored Sep 11, 2023
  
  0a6becae
06 Jun, 2023 1 commit
- bf16 support with test · 0bb60881
  Rick Ho authored Jun 06, 2023
  
  0bb60881
10 Jun, 2022 1 commit
- update ddp with get first rank and tests · dd68fd78
  Rick Ho authored Jun 10, 2022
  
  dd68fd78
10 Oct, 2021 1 commit
- update unit test · 33fc3aca
  Rick Ho authored Oct 10, 2021
  
  33fc3aca
23 May, 2021 1 commit
- mask and experts list · 28ba2d28
  Colin authored May 23, 2021
  
  28ba2d28
19 May, 2021 2 commits
- pass test on single gpu · 670d70ed
  Rick Ho authored May 19, 2021
  
  670d70ed
- update test · f804a121
  Rick Ho authored May 19, 2021
  
  f804a121
29 Apr, 2021 1 commit
- Moved test into numerical. Handled different precision for half tensors · 69151519
  TiagoMAntunes authored Apr 29, 2021
  
  69151519
26 Apr, 2021 1 commit
- add gshard and switch gate with loss · 4c90e6e8
  Rick Ho authored Apr 26, 2021
  
  4c90e6e8
23 Mar, 2021 1 commit
- fix tests after updating megatron · 6868ed2a
  Rick Ho authored Mar 24, 2021
  
  6868ed2a
22 Mar, 2021 1 commit
- Add gshard and noisy gate balance strategy · 89d6c794
  Sengxian authored Mar 22, 2021
  
  89d6c794
09 Mar, 2021 1 commit
- Format using black · 4d48209d
  Sengxian authored Mar 09, 2021
  
  4d48209d
08 Mar, 2021 1 commit
- fix numerical issue in tests and typo · 527a8cc9
  Rick Ho authored Mar 08, 2021
  
  527a8cc9
22 Feb, 2021 3 commits
- fix unpack bug · 092c8d67
  Sengxian authored Feb 22, 2021
  
  092c8d67
- customized top_k and add test for localddp · f39f411a
  Sengxian authored Feb 22, 2021
  
  f39f411a
- add inspection of input.grad in tests · 5cb4e63c
  Rick Ho authored Feb 22, 2021
  
  5cb4e63c
21 Feb, 2021 3 commits
- test bias grad · e36c3c4c
  Jiezhong Qiu authored Feb 21, 2021
  
  e36c3c4c
- new test structure according to new expert_fn structure · 6acc3e41
  Rick Ho authored Feb 21, 2021
  
  6acc3e41
- test bias, dp still not passed · a88d1124
  Jiezhong Qiu authored Feb 21, 2021
  
  a88d1124
08 Feb, 2021 5 commits
- Add model parallel test for FMoE with ddp · dad99892
  Sengxian authored Feb 08, 2021
  
  dad99892
- Seperate ddp test from test_numerical · 06e75b3a
  Sengxian authored Feb 08, 2021
  
  06e75b3a
- Fix top_k=3 testcases · 40841453
  Sengxian authored Feb 08, 2021
  
  40841453
- Fix bug in DDP test · 184b0404
  Sengxian authored Feb 08, 2021
  
  184b0404
- Add test for arbitrary expert in FMoE · 5ead59db
  Sengxian authored Feb 08, 2021
  
  5ead59db
07 Feb, 2021 1 commit
- Add test for FMoE · fc78d5c3
  Sengxian authored Feb 07, 2021
  
  fc78d5c3
01 Feb, 2021 1 commit
- split more tests · 01d9b418
  Rick Ho authored Feb 01, 2021
  
  01d9b418