Commits · 943a96323e06043ff0d4bcf967ad10c544eb946a · OpenDAS / ColossalAI

25 Jul, 2022 4 commits
- [fx] added activation checkpoint codegen support for torch < 1.12 (#1359) · cd063ac3
  Frank Lee authored Jul 25, 2022
  
  cd063ac3
- [unit test] add megatron init test in zero_optim (#1358) · 44178041
  HELSON authored Jul 25, 2022
  
  44178041
- [hotfix] fix megatron_init in test_gpt2.py (#1357) · 7a065dc9
  HELSON authored Jul 25, 2022
  
  7a065dc9
- [fx] added activation checkpoint codegen (#1355) · 644582ee
  Frank Lee authored Jul 25, 2022
  
  644582ee
21 Jul, 2022 2 commits
- [fx] added activation checkpointing annotation (#1349) · 05fae1fd
  Frank Lee authored Jul 21, 2022
```
* [fx] added activation checkpointing annotation

* polish code

* polish code
```
  05fae1fd
- [colotensor] add Tensor.view op and its unit test (#1343) · 7a8702c0
  HELSON authored Jul 21, 2022
```
[colotensor] add megatron initialization for gpt2
```
  7a8702c0
20 Jul, 2022 2 commits

[fx] refactor tracer to trace complete graph (#1342) · 942c8cd1

YuliangLiu0306 authored Jul 20, 2022

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx] refactor tracer to trace complete graph

* add comments and solve conflicts.

942c8cd1

[fx] tested the complete workflow for auto-parallel (#1336) · 2cc1175c
Frank Lee authored Jul 20, 2022
```
* [fx] tested the complete workflow for auto-parallel

* polish code

* polish code

* polish code
```
2cc1175c

19 Jul, 2022 4 commits
- [fx]refactor tracer (#1335) · 4631fef8
  YuliangLiu0306 authored Jul 19, 2022
  
  4631fef8
- [refactor] refactor ColoTensor's unit tests (#1340) · bf5066fb
  HELSON authored Jul 19, 2022
  
  bf5066fb
- [checkpoint] use gather_tensor in checkpoint and update its unit test (#1339) · f92c100d
  HELSON authored Jul 19, 2022
  
  f92c100d
- [fx] recovered skipped pipeline tests (#1338) · f3ce7b83
  Frank Lee authored Jul 19, 2022
  
  f3ce7b83
18 Jul, 2022 2 commits
- [hotfix] ZeroDDP use new process group (#1333) · 0c51ff2c
  ver217 authored Jul 18, 2022
```
* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests
```
  0c51ff2c
- [fx] fixed compatiblity issue with torch 1.10 (#1331) · 75abc75c
  Frank Lee authored Jul 18, 2022
  
  75abc75c
15 Jul, 2022 9 commits
- [test] removed outdated unit test for meta context (#1329) · 169954f8
  Frank Lee authored Jul 15, 2022
  
  169954f8
- [hotfix] shared model returns cpu state_dict (#1328) · 7a053671
  ver217 authored Jul 15, 2022
  
  7a053671
- [fx] fixed unit tests for torch 1.12 (#1327) · b2475d8c
  Frank Lee authored Jul 15, 2022
  
  b2475d8c
- [hotfix] fix ddp for unit test test_gpt2 (#1326) · d49708ae
  HELSON authored Jul 15, 2022
  
  d49708ae
- [utils] integrated colotensor with lazy init context (#1324) · 250be4d3
  Frank Lee authored Jul 15, 2022
```
* [utils] integrated colotensor with lazy init context

* polish code

* polish code

* polish code
```
  250be4d3
- [fx] add balanced policy v2 (#1251) · e8acf55e
  YuliangLiu0306 authored Jul 15, 2022
```
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx] add balanced policy v2

* add unittest
```
  e8acf55e
- [fx] Add unit test and fix bugs for transform_mlp_pass (#1299) · ca2d3f28
  XYE authored Jul 15, 2022
```
* add test and fix bugs

* add functions back

* add comments
```
  ca2d3f28
- [hotfix] fix unit test test_module_spec (#1321) · 1b416864
  HELSON authored Jul 15, 2022
  
  1b416864
- [checkpoint] add ColoOptimizer checkpointing (#1316) · 9e4c6449
  Jiarui Fang authored Jul 15, 2022
  
  9e4c6449
14 Jul, 2022 8 commits
- [Optimizer] Remove useless ColoOptimizer (#1312) · 85f933b5
  Jiarui Fang authored Jul 14, 2022
  
  85f933b5
- [Optimizer] polish the init method of ColoOptimizer (#1310) · 9f105243
  Jiarui Fang authored Jul 14, 2022
  
  9f105243
- [hotfix] fix ColoTensor GPT2 unitest (#1309) · 36086927
  HELSON authored Jul 14, 2022
  
  36086927
- [checkpoint] add test for bert and hotfix save bugs (#1297) · 3ef3791a
  Jiarui Fang authored Jul 14, 2022
  
  3ef3791a
- [hotfix] add missing file (#1308) · bd71e2a8
  Jiarui Fang authored Jul 14, 2022
  
  bd71e2a8
- [fx] added apex normalization to patched modules (#1300) · 4f4d8c36
  Frank Lee authored Jul 14, 2022
```
* [fx] added apex normalization to patched modules

* remove unused imports
```
  4f4d8c36
- [hotfix] remove potiential circle import (#1307) · 4165eabb
  Jiarui Fang authored Jul 14, 2022
```
* make it faster

* [hotfix] remove circle import
```
  4165eabb
- [hotfix] skip some unittest due to CI environment. (#1301) · 93a75433
  YuliangLiu0306 authored Jul 14, 2022
  
  93a75433
13 Jul, 2022 1 commit
- [hotfix] fix shape error in backward when using ColoTensor (#1298) · 260a5580
  HELSON authored Jul 13, 2022
  
  260a5580
12 Jul, 2022 8 commits
- [hotfix] skipped unsafe test cases (#1282) · 7e8114a8
  Frank Lee authored Jul 13, 2022
  
  7e8114a8
- [hotfix] test model unittest hotfix (#1281) · 79fe7b02
  Jiarui Fang authored Jul 12, 2022
  
  79fe7b02
- [hotfix] test_gpt.py duplicated (#1279) · e56731e9
  Jiarui Fang authored Jul 12, 2022
```
* make it faster

* [hotfix] torchvison fx tests

* [hotfix] rename duplicated named test_gpt.py
```
  e56731e9
- [hotfix] fix bert model test in unitests (#1272) · abba4d84
  HELSON authored Jul 12, 2022
  
  abba4d84
- [tests] remove T5 test skip decorator (#1271) · 01ea68b2
  YuliangLiu0306 authored Jul 12, 2022
  
  01ea68b2
- [hotfix] torchvison fx unittests miss import pytest (#1277) · ca9d5ee9
  Jiarui Fang authored Jul 12, 2022
  
  ca9d5ee9
- [tensor] distributed checkpointing for parameters (#1240) · c92f84fc
  Jiarui Fang authored Jul 12, 2022
  
  c92f84fc
- [fx] fixed tracing with apex-based T5 model (#1252) · 4a09fc09
  Frank Lee authored Jul 12, 2022
```
* [fx] fixed tracing with apex-based T5 model

* polish code

* polish code
```
  4a09fc09