Commits · 2cb96b4045cf773e2d4fcfd11a535a210313a51a · OpenDAS / FastMoE

14 Dec, 2022 1 commit
- diverge gshard gate · 6cb550fd
  Rick Ho authored Dec 14, 2022
  
  6cb550fd
04 Aug, 2022 1 commit
- fix GshardGate top1_idx · 5f8e3999
  Fragile-azalea authored Aug 04, 2022
  
  5f8e3999
28 Mar, 2022 1 commit
- Fix GShardGate random_routing · cfd30236
  zms1999 authored Mar 28, 2022
  
  cfd30236
29 May, 2021 1 commit
- fix bugs to run megatron with gshard gate · fa5f45f0
  Rick Ho authored May 29, 2021
  
  fa5f45f0
24 May, 2021 1 commit
- add random routing in gshard gate · e58e7b3b
  Rich Ho authored May 24, 2021
  
  e58e7b3b
18 May, 2021 1 commit
- fix bugs to run on multiple gpus · a468db2b
  Rick Ho authored May 18, 2021
  
  a468db2b
13 May, 2021 3 commits
- test switch gate · 38b334cc
  Rich Ho authored May 13, 2021
  
  38b334cc
- gshard gate test · ddfaaf49
  Rich Ho authored May 13, 2021
  
  ddfaaf49
- add test but cannot pass · 5a0ba835
  Rick Ho authored May 13, 2021
  
  5a0ba835
27 Apr, 2021 2 commits
- gshard prune gate cuda code and test · 56cb8c15
  Rick Ho authored Apr 27, 2021
  
  56cb8c15
- balancing cuda code · 1aced6d8
  Rick Ho authored Apr 27, 2021
  
  1aced6d8
26 Apr, 2021 1 commit
- add gshard and switch gate with loss · 4c90e6e8
  Rick Ho authored Apr 26, 2021
  
  4c90e6e8