Commits · 82023779bb4ca1c70be79c81544c5ca9398106df · OpenDAS / ColossalAI

11 Mar, 2022 2 commits
- Added TPExpert for special situation · 82023779
  1SAA authored Feb 27, 2022
  
  82023779
- Optimized MoE layer and fixed some bugs; · 219df6e6
  1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
  219df6e6
17 Jan, 2022 1 commit
- Added moe parallel example (#140) · 1ff5be36
  HELSON authored Jan 17, 2022
  
  1ff5be36
07 Jan, 2022 1 commit
- Added MoE parallel (#127) · dceae851
  HELSON authored Jan 07, 2022
  
  dceae851