Commits · 828b9e5e0d0e7b5c074e54ad1a75dd1fdaaaab2f · OpenDAS / ColossalAI

"tests/test_tensor/model/test_module_spec.py" did not exist on "5da87ce35d0892ebfc2bb0fe14007f1d7f788271"

28 Jul, 2022 1 commit
- [hotfix] fix zero optim save/load state dict (#1381) · 828b9e5e
  ver217 authored Jul 28, 2022
  
  828b9e5e
27 Jul, 2022 1 commit

[fx] add torchaudio test (#1369) · be229217

Super Daniel authored Jul 27, 2022

* [fx]add torchaudio test

* [fx]add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test and test patches

* Delete ~

* [fx] add patches and patches test

* [fx] add patches and patches test

* [fx] fix patches

* [fx] fix rnn patches

* [fx] fix rnn patches

* [fx] fix rnn patches

* [fx] fix rnn patches

* [fx] merge upstream

* [fx] fix import errors

be229217

26 Jul, 2022 3 commits

[fx] Add colotracer compatibility test on torchrec (#1370) · bb640ec7
Boyuan Yao authored Jul 26, 2022

bb640ec7

[nvme] CPUAdam and HybridAdam support NVMe offload (#1360) · c415240d

ver217 authored Jul 26, 2022

* impl nvme optimizer

* update cpu adam

* add unit test

* update hybrid adam

* update docstr

* add TODOs

* update CI

* fix CI

* fix CI

* fix CI path

* fix CI path

* fix CI path

* fix install tensornvme

* fix CI

* fix CI path

* fix CI env variables

* test CI

* test CI

* fix CI

* fix nvme optim __del__

* fix adam __del__

* fix nvme optim

* fix CI env variables

* fix nvme optim import

* test CI

* test CI

* fix CI

c415240d

[colotensor] use cpu memory to store state_dict (#1367) · 87775a06
HELSON authored Jul 26, 2022

87775a06

25 Jul, 2022 4 commits
- [fx] added activation checkpoint codegen support for torch < 1.12 (#1359) · cd063ac3
  Frank Lee authored Jul 25, 2022
  
  cd063ac3
- [unit test] add megatron init test in zero_optim (#1358) · 44178041
  HELSON authored Jul 25, 2022
  
  44178041
- [hotfix] fix megatron_init in test_gpt2.py (#1357) · 7a065dc9
  HELSON authored Jul 25, 2022
  
  7a065dc9
- [fx] added activation checkpoint codegen (#1355) · 644582ee
  Frank Lee authored Jul 25, 2022
  
  644582ee
21 Jul, 2022 2 commits
- [fx] added activation checkpointing annotation (#1349) · 05fae1fd
  Frank Lee authored Jul 21, 2022
```
* [fx] added activation checkpointing annotation

* polish code

* polish code
```
  05fae1fd
- [colotensor] add Tensor.view op and its unit test (#1343) · 7a8702c0
  HELSON authored Jul 21, 2022
```
[colotensor] add megatron initialization for gpt2
```
  7a8702c0
20 Jul, 2022 2 commits

[fx] refactor tracer to trace complete graph (#1342) · 942c8cd1

YuliangLiu0306 authored Jul 20, 2022

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx] refactor tracer to trace complete graph

* add comments and solve conflicts.

942c8cd1

[fx] tested the complete workflow for auto-parallel (#1336) · 2cc1175c
Frank Lee authored Jul 20, 2022
```
* [fx] tested the complete workflow for auto-parallel

* polish code

* polish code

* polish code
```
2cc1175c

19 Jul, 2022 4 commits
- [fx]refactor tracer (#1335) · 4631fef8
  YuliangLiu0306 authored Jul 19, 2022
  
  4631fef8
- [refactor] refactor ColoTensor's unit tests (#1340) · bf5066fb
  HELSON authored Jul 19, 2022
  
  bf5066fb
- [checkpoint] use gather_tensor in checkpoint and update its unit test (#1339) · f92c100d
  HELSON authored Jul 19, 2022
  
  f92c100d
- [fx] recovered skipped pipeline tests (#1338) · f3ce7b83
  Frank Lee authored Jul 19, 2022
  
  f3ce7b83
18 Jul, 2022 2 commits
- [hotfix] ZeroDDP use new process group (#1333) · 0c51ff2c
  ver217 authored Jul 18, 2022
```
* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests
```
  0c51ff2c
- [fx] fixed compatiblity issue with torch 1.10 (#1331) · 75abc75c
  Frank Lee authored Jul 18, 2022
  
  75abc75c
15 Jul, 2022 9 commits
- [test] removed outdated unit test for meta context (#1329) · 169954f8
  Frank Lee authored Jul 15, 2022
  
  169954f8
- [hotfix] shared model returns cpu state_dict (#1328) · 7a053671
  ver217 authored Jul 15, 2022
  
  7a053671
- [fx] fixed unit tests for torch 1.12 (#1327) · b2475d8c
  Frank Lee authored Jul 15, 2022
  
  b2475d8c
- [hotfix] fix ddp for unit test test_gpt2 (#1326) · d49708ae
  HELSON authored Jul 15, 2022
  
  d49708ae
- [utils] integrated colotensor with lazy init context (#1324) · 250be4d3
  Frank Lee authored Jul 15, 2022
```
* [utils] integrated colotensor with lazy init context

* polish code

* polish code

* polish code
```
  250be4d3
- [fx] add balanced policy v2 (#1251) · e8acf55e
  YuliangLiu0306 authored Jul 15, 2022
```
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx] add balanced policy v2

* add unittest
```
  e8acf55e
- [fx] Add unit test and fix bugs for transform_mlp_pass (#1299) · ca2d3f28
  XYE authored Jul 15, 2022
```
* add test and fix bugs

* add functions back

* add comments
```
  ca2d3f28
- [hotfix] fix unit test test_module_spec (#1321) · 1b416864
  HELSON authored Jul 15, 2022
  
  1b416864
- [checkpoint] add ColoOptimizer checkpointing (#1316) · 9e4c6449
  Jiarui Fang authored Jul 15, 2022
  
  9e4c6449
14 Jul, 2022 8 commits
- [Optimizer] Remove useless ColoOptimizer (#1312) · 85f933b5
  Jiarui Fang authored Jul 14, 2022
  
  85f933b5
- [Optimizer] polish the init method of ColoOptimizer (#1310) · 9f105243
  Jiarui Fang authored Jul 14, 2022
  
  9f105243
- [hotfix] fix ColoTensor GPT2 unitest (#1309) · 36086927
  HELSON authored Jul 14, 2022
  
  36086927
- [checkpoint] add test for bert and hotfix save bugs (#1297) · 3ef3791a
  Jiarui Fang authored Jul 14, 2022
  
  3ef3791a
- [hotfix] add missing file (#1308) · bd71e2a8
  Jiarui Fang authored Jul 14, 2022
  
  bd71e2a8
- [fx] added apex normalization to patched modules (#1300) · 4f4d8c36
  Frank Lee authored Jul 14, 2022
```
* [fx] added apex normalization to patched modules

* remove unused imports
```
  4f4d8c36
- [hotfix] remove potiential circle import (#1307) · 4165eabb
  Jiarui Fang authored Jul 14, 2022
```
* make it faster

* [hotfix] remove circle import
```
  4165eabb
- [hotfix] skip some unittest due to CI environment. (#1301) · 93a75433
  YuliangLiu0306 authored Jul 14, 2022
  
  93a75433
13 Jul, 2022 1 commit
- [hotfix] fix shape error in backward when using ColoTensor (#1298) · 260a5580
  HELSON authored Jul 13, 2022
  
  260a5580
12 Jul, 2022 3 commits
- [hotfix] skipped unsafe test cases (#1282) · 7e8114a8
  Frank Lee authored Jul 13, 2022
  
  7e8114a8
- [hotfix] test model unittest hotfix (#1281) · 79fe7b02
  Jiarui Fang authored Jul 12, 2022
  
  79fe7b02
- [hotfix] test_gpt.py duplicated (#1279) · e56731e9
  Jiarui Fang authored Jul 12, 2022
```
* make it faster

* [hotfix] torchvison fx tests

* [hotfix] rename duplicated named test_gpt.py
```
  e56731e9