Commits · 8cbe171dea3f121470a5410dc26de9156accc0a8 · OpenDAS / FastMoE

16 Sep, 2022 1 commit
- document for examples · 8cbe171d
  Rick Ho authored Sep 16, 2022
  
  8cbe171d
04 Aug, 2022 2 commits
- Merge pull request #130 from Fragile-azalea/master · 40f5fd36
  Rick Ho authored Aug 04, 2022
```
Fix GshardGate top1_idx
```
  40f5fd36
- fix GshardGate top1_idx · 5f8e3999
  Fragile-azalea authored Aug 04, 2022
  
  5f8e3999
23 Jul, 2022 2 commits
- Merge pull request #127 from heheda12345/master · f2e0d1d5
  Rick Ho authored Jul 23, 2022
```
update readme: enable NCCL by default
```
  f2e0d1d5
- update readme: enable NCCL by default · 069da0e8
  heheda authored Jul 23, 2022
  
  069da0e8
18 Jul, 2022 2 commits
- Merge pull request #123 from laekov/torch-v1.12.0-compat · 5a5dfa18
  Rick Ho authored Jul 18, 2022
```
Fix nccl uid bcast for torch v1.12.0
```
  5a5dfa18
- fix nccl uid bcast · a0b1e31a
  Rick Ho authored Jul 18, 2022
  
  a0b1e31a
12 Jun, 2022 1 commit
- Merge pull request #120 from laekov/ddp-bcast-fix · 9a01f8fa
  Rick Ho authored Jun 12, 2022
```
Fix Broadcast rank bug in DGDP
```
  9a01f8fa
10 Jun, 2022 1 commit
- update ddp with get first rank and tests · dd68fd78
  Rick Ho authored Jun 10, 2022
  
  dd68fd78
01 Jun, 2022 4 commits
- Merge pull request #117 from laekov/distributed-doc · 670e1407
  Rick Ho authored Jun 01, 2022
```
Add a hint for DGDP synchronization
```
  670e1407
- add an option of init sync · 039b4550
  Rick Ho authored Jun 01, 2022
  
  039b4550
- fix bug for sync_params · 6fe415e9
  Rick Ho authored Jun 01, 2022
  
  6fe415e9
- add a hint for DGDP synchronization · 21a331fb
  Rick Ho authored Jun 01, 2022
  
  21a331fb
27 May, 2022 2 commits
- Merge pull request #115 from laekov/gate-test-fix · 527e66af
  Rick Ho authored May 27, 2022
```
Fix gshard gate test
```
  527e66af
- fix gshard gate test · e01c8b5f
  Rick Ho authored May 27, 2022
  
  e01c8b5f
26 May, 2022 2 commits
- Merge pull request #113 from laekov/compat-fix · d3f71f21
  Rick Ho authored May 26, 2022
```
Fix smart schedule with older PyTorch
```
  d3f71f21
- fix schedule with older autograd · db247e85
  Rick Ho authored May 26, 2022
  
  db247e85
30 Apr, 2022 7 commits
- Merge pull request #108 from laekov/faster-bug · 5083a736
  Rick Ho authored Apr 30, 2022
```
Fix type mismatch, shape mismatch and lack of condition in FasterMoE's expert shadowing
```
  5083a736
- add condition of skipping pop params · 4682c1d0
  zms1999 authored Apr 30, 2022
  
  4682c1d0
- fix type mismatch · 9f7cbd15
  zms1999 authored Apr 30, 2022
  
  9f7cbd15
- fix shape mismatch in set_grad · 0edd811d
  zms1999 authored Apr 30, 2022
  
  0edd811d
- Merge pull request #107 from laekov/faster-bug · 665b99bf
  Rick Ho authored Apr 30, 2022
```
fix bug: skip computeFn when batch is empty
```
  665b99bf
- fix typo in shadow policy · d90ff389
  zms1999 authored Apr 30, 2022
  
  d90ff389
- skip computeFn when micro_batch_size == 0 · 2ce87038
  zms1999 authored Apr 30, 2022
  
  2ce87038
02 Apr, 2022 5 commits
- Merge pull request #104 from laekov/faster-doc · 59bcec8e
  Rick Ho authored Apr 02, 2022
```
Documents for FasterMoE
```
  59bcec8e
- release note v1.0.0 · 33895a05
  Rick Ho authored Apr 02, 2022
  
  33895a05
- some comments on code and test · 1b8fef31
  Rick Ho authored Apr 02, 2022
  
  1b8fef31
- Merge remote-tracking branch 'github/master' into faster-doc · 4cc893aa
  Rick Ho authored Apr 02, 2022
  
  4cc893aa
- Merge pull request #103 from laekov/faster-expert-shadow · a6a8c4a7
  Rick Ho authored Apr 02, 2022
```
FasterMoE Expert Shadowing
```
  a6a8c4a7
01 Apr, 2022 6 commits
- update chinese url · 6557e88e
  Rick Ho authored Apr 01, 2022
  
  6557e88e
- Merge pull request #102 from laekov/faster-smart-sch · 0c308313
  Rick Ho authored Apr 01, 2022
```
Faster Scheduling
```
  0c308313
- update chinese readme · baa47d46
  Rick Ho authored Apr 01, 2022
  
  baa47d46
- readme for fastermoe · 7e645947
  Rick Ho authored Apr 01, 2022
  
  7e645947
- update readme · 0129ab02
  Rick Ho authored Apr 01, 2022
  
  0129ab02
- faster policies · 91a5e794
  Rick Ho authored Apr 01, 2022
  
  91a5e794
31 Mar, 2022 1 commit
- expert shadow backward with test · 794dd0e6
  Rick Ho authored Mar 31, 2022
  
  794dd0e6
30 Mar, 2022 3 commits
- forward tested · b5b72d41
  Rick Ho authored Mar 30, 2022
  
  b5b72d41
- forward code in smart schedule · 771dc62d
  Rick Ho authored Mar 30, 2022
  
  771dc62d
- fix potential stream synchronization issue · ad651f03
  Rick Ho authored Mar 30, 2022
  
  ad651f03
29 Mar, 2022 1 commit
- fix backward grad weight bug · 6c68b56b
  Rick Ho authored Mar 30, 2022
  
  6c68b56b