Commits · a0b1e31af07bbafab621305515e325d2b4e19283 · OpenDAS / FastMoE

18 Jul, 2022 1 commit
- fix nccl uid bcast · a0b1e31a
  Rick Ho authored Jul 18, 2022
  
  a0b1e31a
10 Jun, 2022 1 commit
- update ddp with get first rank and tests · dd68fd78
  Rick Ho authored Jun 10, 2022
  
  dd68fd78
01 Jun, 2022 4 commits
- Merge pull request #117 from laekov/distributed-doc · 670e1407
  Rick Ho authored Jun 01, 2022
```
Add a hint for DGDP synchronization
```
  670e1407
- add an option of init sync · 039b4550
  Rick Ho authored Jun 01, 2022
  
  039b4550
- fix bug for sync_params · 6fe415e9
  Rick Ho authored Jun 01, 2022
  
  6fe415e9
- add a hint for DGDP synchronization · 21a331fb
  Rick Ho authored Jun 01, 2022
  
  21a331fb
27 May, 2022 2 commits
- Merge pull request #115 from laekov/gate-test-fix · 527e66af
  Rick Ho authored May 27, 2022
```
Fix gshard gate test
```
  527e66af
- fix gshard gate test · e01c8b5f
  Rick Ho authored May 27, 2022
  
  e01c8b5f
26 May, 2022 2 commits
- Merge pull request #113 from laekov/compat-fix · d3f71f21
  Rick Ho authored May 26, 2022
```
Fix smart schedule with older PyTorch
```
  d3f71f21
- fix schedule with older autograd · db247e85
  Rick Ho authored May 26, 2022
  
  db247e85
30 Apr, 2022 7 commits
- Merge pull request #108 from laekov/faster-bug · 5083a736
  Rick Ho authored Apr 30, 2022
```
Fix type mismatch, shape mismatch and lack of condition in FasterMoE's expert shadowing
```
  5083a736
- add condition of skipping pop params · 4682c1d0
  zms1999 authored Apr 30, 2022
  
  4682c1d0
- fix type mismatch · 9f7cbd15
  zms1999 authored Apr 30, 2022
  
  9f7cbd15
- fix shape mismatch in set_grad · 0edd811d
  zms1999 authored Apr 30, 2022
  
  0edd811d
- Merge pull request #107 from laekov/faster-bug · 665b99bf
  Rick Ho authored Apr 30, 2022
```
fix bug: skip computeFn when batch is empty
```
  665b99bf
- fix typo in shadow policy · d90ff389
  zms1999 authored Apr 30, 2022
  
  d90ff389
- skip computeFn when micro_batch_size == 0 · 2ce87038
  zms1999 authored Apr 30, 2022
  
  2ce87038
02 Apr, 2022 5 commits
- Merge pull request #104 from laekov/faster-doc · 59bcec8e
  Rick Ho authored Apr 02, 2022
```
Documents for FasterMoE
```
  59bcec8e
- release note v1.0.0 · 33895a05
  Rick Ho authored Apr 02, 2022
  
  33895a05
- some comments on code and test · 1b8fef31
  Rick Ho authored Apr 02, 2022
  
  1b8fef31
- Merge remote-tracking branch 'github/master' into faster-doc · 4cc893aa
  Rick Ho authored Apr 02, 2022
  
  4cc893aa
- Merge pull request #103 from laekov/faster-expert-shadow · a6a8c4a7
  Rick Ho authored Apr 02, 2022
```
FasterMoE Expert Shadowing
```
  a6a8c4a7
01 Apr, 2022 6 commits
- update chinese url · 6557e88e
  Rick Ho authored Apr 01, 2022
  
  6557e88e
- Merge pull request #102 from laekov/faster-smart-sch · 0c308313
  Rick Ho authored Apr 01, 2022
```
Faster Scheduling
```
  0c308313
- update chinese readme · baa47d46
  Rick Ho authored Apr 01, 2022
  
  baa47d46
- readme for fastermoe · 7e645947
  Rick Ho authored Apr 01, 2022
  
  7e645947
- update readme · 0129ab02
  Rick Ho authored Apr 01, 2022
  
  0129ab02
- faster policies · 91a5e794
  Rick Ho authored Apr 01, 2022
  
  91a5e794
31 Mar, 2022 1 commit
- expert shadow backward with test · 794dd0e6
  Rick Ho authored Mar 31, 2022
  
  794dd0e6
30 Mar, 2022 3 commits
- forward tested · b5b72d41
  Rick Ho authored Mar 30, 2022
  
  b5b72d41
- forward code in smart schedule · 771dc62d
  Rick Ho authored Mar 30, 2022
  
  771dc62d
- fix potential stream synchronization issue · ad651f03
  Rick Ho authored Mar 30, 2022
  
  ad651f03
29 Mar, 2022 5 commits
- fix backward grad weight bug · 6c68b56b
  Rick Ho authored Mar 30, 2022
  
  6c68b56b
- backward bugous on grad weight · a807e2a3
  Rick Ho authored Mar 29, 2022
  
  a807e2a3
- forward pass test · 46c3722d
  Rick Ho authored Mar 29, 2022
  
  46c3722d
- Merge pull request #101 from laekov/faster-topo-gate · 53ecd24b
  zms1999 authored Mar 29, 2022
```
Faster topo gate
```
  53ecd24b
- readme grammar fix · 14cb8545
  Rick Ho authored Mar 29, 2022
  
  14cb8545
28 Mar, 2022 3 commits
- test for faster gate · 49b5b5d6
  Rick Ho authored Mar 28, 2022
  
  49b5b5d6
- faster gate develop · 6e1fcca1
  Rick Ho authored Mar 28, 2022
  
  6e1fcca1
- Merge pull request #100 from laekov/doc-fix · 98e24e24
  zms1999 authored Mar 28, 2022
```
Fix document for megatron
```
  98e24e24