Commits · 9ec1ce6ab1a287d898a2cb261d6ce6aa72db5512 · OpenDAS / ColossalAI

21 Mar, 2022 2 commits
- [format] polish name format for MOE (#481) · 65c0f380
  Jiarui Fang authored Mar 21, 2022
  
  65c0f380
- [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) · 75443471
  HELSON authored Mar 21, 2022
  
  75443471
18 Mar, 2022 1 commit
- add moe context, moe utilities and refactor gradient handler (#455) · 84fd7c1d
  HELSON authored Mar 18, 2022
  
  84fd7c1d
11 Mar, 2022 2 commits
- Added TPExpert for special situation · 82023779
  1SAA authored Feb 27, 2022
  
  82023779
- Optimized MoE layer and fixed some bugs; · 219df6e6
  1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
  219df6e6