Commits · 0dac86866b9e2de017be724aa3aebbd6b19eb705 · OpenDAS / ColossalAI

24 Mar, 2022 1 commit
- [MOE] add MOEGPT model (#510) · 0f2d2191
  HELSON authored Mar 24, 2022
  
  0f2d2191
23 Mar, 2022 1 commit
- [polish] polish singleton and global context (#500) · a445e118
  Jiarui Fang authored Mar 23, 2022
  
  a445e118
22 Mar, 2022 1 commit
- [MOE] support PR-MOE (#488) · c9023d40
  HELSON authored Mar 22, 2022
  
  c9023d40
21 Mar, 2022 1 commit
- [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) · 75443471
  HELSON authored Mar 21, 2022
  
  75443471
16 Mar, 2022 1 commit
- added Multiply Jitter and capacity factor eval for MOE (#434) · dbdc9a77
  HELSON authored Mar 16, 2022
  
  dbdc9a77
11 Mar, 2022 2 commits
- Added TPExpert for special situation · 82023779
  1SAA authored Feb 27, 2022
  
  82023779
- Optimized MoE layer and fixed some bugs; · 219df6e6
  1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
  219df6e6
17 Jan, 2022 1 commit
- Added moe parallel example (#140) · 1ff5be36
  HELSON authored Jan 17, 2022
  
  1ff5be36
07 Jan, 2022 1 commit
- Added MoE parallel (#127) · dceae851
  HELSON authored Jan 07, 2022
  
  dceae851