Commits · 754434714599dde6a0b4f51cc4763853febd371c · OpenDAS / ColossalAI

21 Mar, 2022 1 commit
- [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) · 75443471
  HELSON authored Mar 21, 2022
  
  75443471
16 Mar, 2022 1 commit
- added Multiply Jitter and capacity factor eval for MOE (#434) · dbdc9a77
  HELSON authored Mar 16, 2022
  
  dbdc9a77
11 Mar, 2022 2 commits
- Added TPExpert for special situation · 82023779
  1SAA authored Feb 27, 2022
  
  82023779
- Optimized MoE layer and fixed some bugs; · 219df6e6
  1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
  219df6e6
17 Jan, 2022 1 commit
- Added moe parallel example (#140) · 1ff5be36
  HELSON authored Jan 17, 2022
  
  1ff5be36
07 Jan, 2022 1 commit
- Added MoE parallel (#127) · dceae851
  HELSON authored Jan 07, 2022
  
  dceae851