Commits · 0653c63eaacd1504f5d66f2e11f80defdb155832 · OpenDAS / ColossalAI

19 May, 2022 1 commit
- [unit test] refactor test tensor (#1005) · 8e3d0ad8
  ver217 authored May 19, 2022
```
* polish test_gpt

* update op unit tests

* update test model
```
  8e3d0ad8
07 May, 2022 1 commit
- [Tensor] add 1d vocab loss (#918) · 75d22191
  Ziyue Jiang authored May 07, 2022
```
* add 1d vocab loss

* polish
```
  75d22191
06 May, 2022 1 commit
- [Tensor] fix test_model (#916) · dfaff4e2
  Ziyue Jiang authored May 06, 2022
```
* polish test_model

* polish
```
  dfaff4e2
29 Apr, 2022 1 commit
- [Tensor] add embedding tp1d row (#904) · f593a563
  Ziyue Jiang authored Apr 29, 2022
  
  f593a563
25 Apr, 2022 2 commits
- [tensor] add cross_entrophy_loss (#868) · 1190b2c4
  Jiarui Fang authored Apr 25, 2022
  
  1190b2c4
- [ci] cache cuda extension (#860) · 1258af71
  Frank Lee authored Apr 25, 2022
  
  1258af71
24 Apr, 2022 2 commits
- [Tensor ] Add 1Drow weight reshard by spec (#854) · bcc86550
  Ziyue Jiang authored Apr 24, 2022
  
  bcc86550
- [Tensor] init a tp network training unittest (#849) · 62f05925
  Jiarui Fang authored Apr 24, 2022
  
  62f05925
01 Apr, 2022 1 commit
- [zero] adapt zero for unsharded paramters (Optimizer part) (#601) · 055fbf5b
  HELSON authored Apr 01, 2022
  
  055fbf5b
28 Mar, 2022 1 commit

[zero] adapt for no-leaf module in zero (#535) · a30e2b4c

HELSON authored Mar 28, 2022

only process module's own parameters in Zero context

add zero hooks for all modules that contrain parameters

gather parameters only belonging to module itself

a30e2b4c

14 Mar, 2022 1 commit
- [zero] new interface for ShardedOptimv2 (#406) · 370f567e
  Jiarui Fang authored Mar 14, 2022
  
  370f567e
11 Mar, 2022 6 commits
- [unit test] Refactored test cases with component func (#339) · 526a3180
  Frank Lee authored Mar 11, 2022
```
* refactored test with component func

* fixed bug
```
  526a3180
- fix bert unit test · f5f0ad26
  ver217 authored Mar 09, 2022
  
  f5f0ad26
- adapting bert unitest interface · 4d94cd51
  jiaruifang authored Mar 09, 2022
  
  4d94cd51
- add bert for unitest and sharded model is not able to pass the bert case · 7977422a
  jiaruifang authored Mar 09, 2022
  
  7977422a
- [zero] update zero context init with the updated test utils (#327) · 11bddb6e
  Jiarui Fang authored Mar 08, 2022
  
  11bddb6e
- [test] refactored testing components (#324) · 6268446b
  Frank Lee authored Mar 08, 2022
  
  6268446b