Commits · 899aa86368d9c0d9b3eda8b4186c78018cd56761 · OpenDAS / ColossalAI

Frank Lee authored Apr 06, 2023

* [test] added spawn decorator

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

80eba05b

23 Sep, 2022 1 commit
- [moe] fix moe bugs (#1633) · a088022e
  HELSON authored Sep 23, 2022
  
  a088022e
22 Sep, 2022 1 commit
- [moe] fix MoE bugs (#1628) · f7f22487
  HELSON authored Sep 22, 2022
```
* remove forced FP32 modules

* correct no_shard-contexts' positions
```
  f7f22487
14 Apr, 2022 1 commit
- [test] refactored with the new rerun decorator (#763) · 5a1a095b
  Frank Lee authored Apr 15, 2022
```
* [test] refactored with the new rerun decorator

* polish test case
```
  5a1a095b
29 Mar, 2022 1 commit
- Refactored docstring to google style · ec5086c4
  Liang Bowen authored Mar 25, 2022
  
  ec5086c4
25 Mar, 2022 1 commit
- [test] fixed rerun_on_exception and adapted test cases (#487) · 3601b2ba
  Frank Lee authored Mar 25, 2022
  
  3601b2ba
23 Mar, 2022 1 commit
- [polish] polish singleton and global context (#500) · a445e118
  Jiarui Fang authored Mar 23, 2022
  
  a445e118
21 Mar, 2022 1 commit
- [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) · 75443471
  HELSON authored Mar 21, 2022
  
  75443471
18 Mar, 2022 1 commit
- add moe context, moe utilities and refactor gradient handler (#455) · 84fd7c1d
  HELSON authored Mar 18, 2022
  
  84fd7c1d
11 Mar, 2022 2 commits
- Added TPExpert for special situation · 82023779
  1SAA authored Feb 27, 2022
  
  82023779
- Optimized MoE layer and fixed some bugs; · 219df6e6
  1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
  219df6e6