Commits · 23442a5bc19ca84dce4c2434eba1cb0bc64c13a9 · OpenDAS / ColossalAI

04 Jul, 2022 2 commits

Automated submodule synchronization (#1194) · 23442a5b
github-actions[bot] authored Jul 04, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
23442a5b

[context]support arbitary module materialization. (#1193) · 63d2a938

YuliangLiu0306 authored Jul 04, 2022

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [context]support arbitary module materialization.

* [test]add numerical check for lazy init context.

63d2a938

30 Jun, 2022 2 commits
- warmup ratio configration (#1192) · a444633d
  Jiarui Fang authored Jun 30, 2022
  
  a444633d
- make AutoPlacementPolicy configurable (#1191) · dba7e0cf
  ver217 authored Jun 30, 2022
  
  dba7e0cf
29 Jun, 2022 8 commits
- [context]use meta tensor to init model lazily. (#1187) · 2053e138
  YuliangLiu0306 authored Jun 29, 2022
```
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [context]use meta tensor to init model lazily.

* polish

* make module with device kwargs bypass the normal init.

* change unit test to adapt updated context.
```
  2053e138
- [fx] patched conv and normalization (#1188) · 2c8c0567
  Frank Lee authored Jun 29, 2022
  
  2c8c0567
- Automated submodule synchronization (#1159) · 6f0733a1
  github-actions[bot] authored Jun 29, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  6f0733a1
- [fx] supported data-dependent control flow in model tracing (#1185) · 6d86f1bc
  Frank Lee authored Jun 29, 2022
```
* [fx] supported data-dependent control flow in model tracing

* polish code
```
  6d86f1bc
- [tensor] remove gpc in tensor tests (#1186) · c463f8ad
  Jiarui Fang authored Jun 29, 2022
  
  c463f8ad
- [refactor] move chunk and chunkmgr to directory gemini (#1182) · 372f7914
  Jiarui Fang authored Jun 29, 2022
  
  372f7914
- [ddp] ColoDDP uses bucket all-reduce (#1177) · 6b2f2ab9
  ver217 authored Jun 29, 2022
```
* add reducer

* update colo ddp with reducer

* polish unit test

* polish unit test
```
  6b2f2ab9
- [ColoTensor] add independent process group (#1179) · 7487215b
  Jiarui Fang authored Jun 29, 2022
  
  7487215b
28 Jun, 2022 1 commit

[hotfix]fixed p2p process send stuck (#1181) · 26ba8727

YuliangLiu0306 authored Jun 28, 2022

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [hotfix]fixed p2p process send stuck

26ba8727

27 Jun, 2022 5 commits
- [tensor] revert local view back (#1178) · 1b657f9c
  Jiarui Fang authored Jun 27, 2022
  
  1b657f9c
- [Tensor] rename some APIs in TensorSpec and Polish view unittest (#1176) · 0dd4e2bb
  Jiarui Fang authored Jun 27, 2022
  
  0dd4e2bb
- [Tensor] rename parallel_action (#1174) · dd042090
  Ziyue Jiang authored Jun 27, 2022
```
* rename parallel_action

* polish
```
  dd042090
- [hotfix]different overflow status lead to communication stuck. (#1175) · e2764537
  YuliangLiu0306 authored Jun 27, 2022
```
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [hotfix]fix some bugs caused by refactored schedule.

* [hotfix]different overflow statu llead to communication stuck.
```
  e2764537
- [Tensor] distributed view supports inter-process hybrid parallel (#1169) · aa7bef73
  Jiarui Fang authored Jun 27, 2022
  
  aa7bef73
24 Jun, 2022 3 commits
- [zero] sharded optim supports loading local state dict (#1170) · 9e1daa63
  ver217 authored Jun 24, 2022
```
* sharded optim supports loading local state dict

* polish code

* add unit test
```
  9e1daa63
- [zero] zero optim supports loading local state dict (#1171) · 561e9049
  ver217 authored Jun 24, 2022
```
* zero optim supports loading local state dict

* polish code

* add unit test
```
  561e9049
- [ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168) · 4b9bba81
  Jiarui Fang authored Jun 24, 2022
  
  4b9bba81
23 Jun, 2022 6 commits
- [Tensor] remove ParallelAction, use ComputeSpec instread (#1166) · f4ef2243
  Jiarui Fang authored Jun 23, 2022
  
  f4ef2243
- remove gather out in parallel action (#1163) · 177c3744
  Jiarui Fang authored Jun 23, 2022
  
  177c3744
- [workflow] polish readme and dockerfile (#1165) · 51f1ec96
  Frank Lee authored Jun 23, 2022
```
* [workflow] polish readme and dockerfile

* polish
```
  51f1ec96
- [workflow] auto-publish docker image upon release (#1164) · ca73028a
  Frank Lee authored Jun 23, 2022
  
  ca73028a
- mark sanity_check of dist_spec_mgr as staticmethod (#1161) · 634eecb9
  ver217 authored Jun 23, 2022
  
  634eecb9
- remove log (#1160) · 955ac912
  Ziyue Jiang authored Jun 23, 2022
  
  955ac912
22 Jun, 2022 11 commits
- fix chunk move device (#1158) · 4e67b2a8
  ver217 authored Jun 22, 2022
  
  4e67b2a8
- [graph] improve the graph building. (#1157) · 07f9c781
  Jiarui Fang authored Jun 22, 2022
  
  07f9c781
- [tensor] add embedding bag op (#1156) · 22717a85
  ver217 authored Jun 22, 2022
  
  22717a85
- [tensor] add more element-wise ops (#1155) · ae861519
  ver217 authored Jun 22, 2022
```
* add more element-wise ops

* update test_op

* polish unit test
```
  ae861519
- Automated submodule synchronization (#1129) · e8c34eed
  github-actions[bot] authored Jun 22, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  e8c34eed
- [workflow] fixed release post workflow (#1154) · d415d732
  Frank Lee authored Jun 22, 2022
  
  d415d732
- [gemini] refactor gemini mgr (#1151) · 54aabb8d
  ver217 authored Jun 22, 2022
```
* refactor gemini mgr

* udpate __init__
```
  54aabb8d
- [tensor] fixed non-serializable colo parameter during model checkpointing (#1153) · f8eec98f
  Frank Lee authored Jun 22, 2022
  
  f8eec98f
- [tensor] dist spec s2s uses all-to-all (#1136) · ffa025e1
  ver217 authored Jun 22, 2022
```
* dist spec s2s uses all-to-all

* update unit test

* add sanity check

* polish unitest test with titans

* add sanity check for DistMgr

* add sanity check
Co-authored-by: jiaruifang <fangjiarui123@gmail.com>
```
  ffa025e1
- [workflow] fixed format error in yaml file (#1145) · c77da0dc
  Frank Lee authored Jun 22, 2022
  
  c77da0dc
- polish unitest test with titans (#1152) · ff644ee5
  Jiarui Fang authored Jun 22, 2022
  
  ff644ee5
21 Jun, 2022 2 commits
- [hotfix]fix some bugs caused by refactored schedule. (#1148) · f1f51990
  YuliangLiu0306 authored Jun 21, 2022
```
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [hotfix]fix some bugs caused by refactored schedule.
```
  f1f51990
- [ColoTensor] improves init functions. (#1150) · 8cdce039
  Jiarui Fang authored Jun 21, 2022
  
  8cdce039