Commits · 0160a62a3c8f2b4bef5edd9997037fba69bf0da7 · OpenDAS / ColossalAI

"vscode:/vscode.git/clone" did not exist on "50793b35f49379ecc7b3f8a1a4f858522a561133"

24 Nov, 2022 2 commits
- [Gemini] param_tracer_wrapper and test case (#2009) · 0160a62a
  Zihao authored Nov 24, 2022
  
  0160a62a
- [autoparallel] add experimental view handler (#2011) · 14389931
  YuliangLiu0306 authored Nov 24, 2022
```
* [autoparallel] add experimental view handler

* polish

* polish

* polish code

* rename variables
```
  14389931
23 Nov, 2022 8 commits

[autoparallel] mix gather (#1977) · d655eea5

Genghan Zhang authored Nov 23, 2022

* Add mix-gather

* Add comments

* Add comments

* Polish comments

* Change the global rank assumption

* Add tests

* Add two-step tests

* Fix 10 and 01

* Skip test becasue the number of GPUs

d655eea5

[workflow] fixed the python and cpu arch mismatch (#2010) · 7242bffc
Frank Lee authored Nov 23, 2022

7242bffc
[release] release v0.1.11rc4 (#2007) · 2bab6f51
Frank Lee authored Nov 23, 2022

2bab6f51
[Gemini] add an inline_op_module to common test models and polish unitests. (#2004) · 3d907fae
Jiarui Fang authored Nov 23, 2022

3d907fae
[workflow] fixed the typo in condarc (#2006) · 56a3dcda
Frank Lee authored Nov 23, 2022

56a3dcda
[workflow] added conda cache and fixed no-compilation bug in release (#2005) · 7ad9bd14
Frank Lee authored Nov 23, 2022

7ad9bd14

[autoparallel] Add metainfo support for F.linear (#1987) · 6cd784ff

Boyuan Yao authored Nov 23, 2022

* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input

* [autoparallel] add pooling metainfo

* [autoparallel] add F.linear metainfo generator

6cd784ff

[fx] add more meta_registry for MetaTensor execution. (#2000) · 2edbef13

Super Daniel authored Nov 23, 2022

* [sc] add examples for auto checkpoint.

* merge upstream

* [fx] add more meta_registry for MetaTensor execution.

2edbef13

22 Nov, 2022 2 commits
- [NFC] polish license (#1999) · d00d905b
  binmakeswell authored Nov 22, 2022
  
  d00d905b
- [hotfix] make Gemini work for conv DNN (#1998) · a2d32666
  Jiarui Fang authored Nov 22, 2022
  
  a2d32666
21 Nov, 2022 2 commits
- [autoparallel] use pytree map style to process data (#1989) · 15589111
  YuliangLiu0306 authored Nov 21, 2022
  
  15589111
- [autoparallel] adapt handlers with attention block (#1990) · 35e6b9ec
  YuliangLiu0306 authored Nov 21, 2022
```
* [autoparallel] adapt handlers with attention block

* polish
```
  35e6b9ec
20 Nov, 2022 1 commit
- [example] add diffusion inference (#1986) · b5dbb461
  Fazzie-Maqianli authored Nov 20, 2022
  
  b5dbb461
18 Nov, 2022 9 commits
- Update requirements.txt · a01278e8
  binmakeswell authored Nov 18, 2022
  
  a01278e8
- [autoparallel] support more flexible data type (#1967) · 05020e50
  YuliangLiu0306 authored Nov 18, 2022
  
  05020e50
- [Gemini] open grad checkpoint when model building (#1984) · 5bec3b21
  Jiarui Fang authored Nov 18, 2022
  
  5bec3b21
- [autoparallel] add pooling metainfo (#1968) · c26f21d3
  Boyuan Yao authored Nov 18, 2022
```
* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input

* [autoparallel] add pooling metainfo
```
  c26f21d3
- [Gemini] add bert for MemtracerWrapper unintests (#1982) · 3712ac7f
  Jiarui Fang authored Nov 18, 2022
  
  3712ac7f
- [Gemini] MemtracerWrapper unittests (#1981) · e481489a
  Jiarui Fang authored Nov 18, 2022
  
  e481489a
- add RoBERTa (#1980) · 52bd1066
  mandoxzhang authored Nov 18, 2022
```
* update roberta

* update roberta & readme

* update roberta & readme

* update roberta & readme
```
  52bd1066
- [Gemini] memory trace hook (#1978) · 31922110
  Jiarui Fang authored Nov 18, 2022
  
  31922110
- [Gemini] independent runtime tracer (#1974) · 0529fcde
  Jiarui Fang authored Nov 18, 2022
  
  0529fcde
17 Nov, 2022 5 commits
- [autoparallel] support distributed dataloader option (#1906) · 0da1d003
  YuliangLiu0306 authored Nov 17, 2022
```
* [autoparallel] support distributed dataloader option

* update output handler to support ddp dataloader

* poish code
```
  0da1d003
- [autoparallel] Add alpha beta (#1973) · 6630d455
  Genghan Zhang authored Nov 17, 2022
```
* Add alpha beta

* Fix test

* Fix test
```
  6630d455
- [Gemini] ZeROHookV2 -> GeminiZeROHook (#1972) · cc0ed7cf
  Jiarui Fang authored Nov 17, 2022
  
  cc0ed7cf
- [kernel] move all symlinks of kernel to `colossalai._C` (#1971) · f8a7148d
  ver217 authored Nov 17, 2022
  
  f8a7148d
- [Gemini] clean no used MemTraceOp (#1970) · 7e24b9b9
  Jiarui Fang authored Nov 17, 2022
  
  7e24b9b9
16 Nov, 2022 9 commits

[autoparallel] add torch.nn.ReLU metainfo (#1868) · 7c7921f7

Boyuan Yao authored Nov 16, 2022

* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input

7c7921f7

[polish] remove useless file _mem_tracer_hook.py (#1963) · 8c66a1d0
Jiarui Fang authored Nov 16, 2022

8c66a1d0
[Gemini] polish memstats collector (#1962) · c4739a72
Jiarui Fang authored Nov 16, 2022

c4739a72
[autoparallel] support addmm in tracer and solver (#1961) · fea3cb66
YuliangLiu0306 authored Nov 16, 2022
```
* [fx] patch addmm

* [autoparallel] support addmm in tracer and solver
```
fea3cb66
[Gemini] add GeminiAdamOptimizer (#1960) · f7e276fa
Jiarui Fang authored Nov 16, 2022

f7e276fa
[zero] fix memory leak for zero2 (#1955) · 7066dfbf
HELSON authored Nov 16, 2022

7066dfbf

[example] enhance GPT demo (#1959) · 60abd86d

Jiarui Fang authored Nov 16, 2022



* [example] enhence GPT demo

* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>

60abd86d

Merge pull request #1958 from Fazziekey/lightning · acba1429
Fazzie-Maqianli authored Nov 16, 2022
```
update model download in README
```
acba1429
update model download in README · a09f88ab
Fazzie authored Nov 16, 2022

a09f88ab

15 Nov, 2022 2 commits
- update lightning version (#1954) · 6bdd0a90
  Fazzie-Maqianli authored Nov 15, 2022
  
  6bdd0a90
- [ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953) · 52c6ad26
  Jiarui Fang authored Nov 15, 2022
  
  52c6ad26