Commits · 754434714599dde6a0b4f51cc4763853febd371c · OpenDAS / ColossalAI

"examples/simclr_cifar10_data_parallel/models/simclr.py" did not exist on "8f02a88db27757e8f5453dc8c7fe1862f28c525f"

21 Mar, 2022 1 commit
- [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) · 75443471
  HELSON authored Mar 21, 2022
  
  75443471
16 Mar, 2022 1 commit
- added Multiply Jitter and capacity factor eval for MOE (#434) · dbdc9a77
  HELSON authored Mar 16, 2022
  
  dbdc9a77
11 Mar, 2022 2 commits
- Added TPExpert for special situation · 82023779
  1SAA authored Feb 27, 2022
  
  82023779
- Optimized MoE layer and fixed some bugs; · 219df6e6
  1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
  219df6e6
17 Jan, 2022 1 commit
- Added moe parallel example (#140) · 1ff5be36
  HELSON authored Jan 17, 2022
  
  1ff5be36
07 Jan, 2022 1 commit
- Added MoE parallel (#127) · dceae851
  HELSON authored Jan 07, 2022
  
  dceae851