Commits · 6e9730d7abb538ccdae5b4b9b2556d0f8b950835 · OpenDAS / ColossalAI

"vscode:/vscode.git/clone" did not exist on "a22407cc027b2d6b30a21c50258a4285335ec0c8"

08 Nov, 2022 13 commits
- [example] add stable diffuser (#1825) · 6e9730d7
  Fazzie-Maqianli authored Nov 08, 2022
  
  6e9730d7
- [example] simplify the GPT2 huggingface example (#1826) · b1263d32
  Jiarui Fang authored Nov 08, 2022
  
  b1263d32
- [Gemini] make gemini usage simple (#1821) · cd5a0d56
  Jiarui Fang authored Nov 08, 2022
  
  cd5a0d56
- [CheckpointIO] a uniform checkpoint I/O module (#1689) · 99870726
  ver217 authored Nov 08, 2022
  
  99870726
- [autoparallel] add batch norm metainfo (#1815) · 629172b3
  Boyuan Yao authored Nov 08, 2022
```
* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler
```
  629172b3
- Merge pull request #1817 from MaruyamaAya/main · a648d061
  Maruyama_Aya authored Nov 08, 2022
```
add ColoDiffusion code: /ldm/module/, /ldm/data/, /scripts/test/
```
  a648d061
- add ColoDiffusion codes: /ldm/module/, /ldm/data/, /scripts/test/ · a7e8159d
  Maruyama_Aya authored Nov 08, 2022
  
  a7e8159d
- [fx] add a symbolic_trace api. (#1812) · 441d584e
  Super Daniel authored Nov 08, 2022
```
* [fx] add a symbolic_trace api.

* [fx] fix import errors.
```
  441d584e
- [example] opt does not depend on Titans (#1811) · 350ccc04
  Jiarui Fang authored Nov 08, 2022
  
  350ccc04
- [fx] skip diffusers unitest if it is not installed (#1799) · 6fa71d65
  Jiarui Fang authored Nov 08, 2022
  
  6fa71d65
- [example] add GPT · 203ca57a
  Jiarui Fang authored Nov 08, 2022
  
  203ca57a
- [example] add opt model in lauguage (#1809) · fd2c8d81
  Jiarui Fang authored Nov 08, 2022
  
  fd2c8d81
- [hotfix] fix build error when torch version >= 1.13 (#1803) · e0da01ea
  xcnick authored Nov 08, 2022
  
  e0da01ea
07 Nov, 2022 7 commits
- [example] add diffusion to example (#1805) · f5a92c28
  Jiarui Fang authored Nov 07, 2022
  
  f5a92c28
- [kernel] more flexible flashatt interface (#1804) · 9639ea88
  oahzxl authored Nov 07, 2022
  
  9639ea88
- MemStatsCollectorStatic (#1765) · 20e255d4
  Zihao authored Nov 07, 2022
  
  20e255d4
- [autoparallel] add conv metainfo class for auto parallel (#1796) · 327d07c4
  Boyuan Yao authored Nov 07, 2022
```
* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test
```
  327d07c4
- [hotfix] polish flash attention (#1802) · 501a9e9c
  oahzxl authored Nov 07, 2022
  
  501a9e9c
- [NFC] polish type hint for shape consistency (#1801) · 218c75fd
  Jiarui Fang authored Nov 07, 2022
```
* [NFC] polish type hint for shape consistency

* polish code

* polish code
```
  218c75fd
- [kernel] skip tests of flash_attn and triton when they are not available (#1798) · c2488003
  Jiarui Fang authored Nov 07, 2022
  
  c2488003
04 Nov, 2022 2 commits

[autoparallel]add essential CommActions for broadcast oprands (#1793) · e34e850a
YuliangLiu0306 authored Nov 04, 2022

e34e850a

[fx] Add linear metainfo class for auto parallel (#1783) · 05ce3d36

Boyuan Yao authored Nov 04, 2022

* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

05ce3d36

03 Nov, 2022 3 commits

[autoparallel] refactor and add rotorc. (#1789) · e8a9bebc
Super Daniel authored Nov 03, 2022
```
* [autoparallel] refactor and add rotorc.

* [autoparallel] refactor and add rotorc.
```
e8a9bebc
Automated submodule synchronization (#1785) · 4d6e1284
github-actions[bot] authored Nov 03, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
4d6e1284

[autoparallel] add getattr handler (#1767) · 2c4c7b36

YuliangLiu0306 authored Nov 03, 2022

* [autoparallel] add getattr haandler

* polish code

* add extra processes for Parameters

* add unit test for param resharding cost

* add docstring and polish test

2c4c7b36

02 Nov, 2022 4 commits
- [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) · c6a1a626
  HELSON authored Nov 02, 2022
```
* [hotfix] fix zero's incompatibility with checkpoint in torch-1.12

* [zero] add cpu shard init

* [zero] add tiny example test

* [colo_tensor] fix bugs for torch-1.11
```
  c6a1a626
- skip torchrec unittests if not installed (#1790) · 32c1b843
  Jiarui Fang authored Nov 02, 2022
  
  32c1b843
- updated tp layers · 0b8161fa
  kurisusnowdeng authored Oct 26, 2022
  
  0b8161fa
- [hotfix] polish chunk import (#1787) · cb5a587e
  Jiarui Fang authored Nov 02, 2022
  
  cb5a587e
01 Nov, 2022 6 commits
- [fx] support module with bias addition (#1780) · e859380b
  YuliangLiu0306 authored Nov 01, 2022
```
* [autoparallel] refactor tracer to fix bias addition issue

* [fx] support module with bias addition

* create bias_addition_module

* refactor file structure

* polish code

* fix unit test
```
  e859380b
- [autoparallel] added matmul handler (#1763) · f3f19a5c
  Frank Lee authored Nov 01, 2022
```
* [autoparallel] added matmul handler

* polish code
```
  f3f19a5c
- [Pipeline]Adapt to Pipelinable OPT (#1782) · 4df01949
  Ziyue Jiang authored Nov 01, 2022
  
  4df01949
- [autoparallel] fix conv handler numerical test (#1771) · 27de2523
  YuliangLiu0306 authored Nov 01, 2022
  
  27de2523
- [autoparallel] move ckpt solvers to autoparallel folder / refactor code (#1764) · 1e88811c
  Super Daniel authored Nov 01, 2022
```
* [autoparallel] first move.

* [autoparallel] add solver rotor.

* [autoparallel] add ckpt solvers.

* [autoparallel] modify codegen.

* [fx] fix annotation in test.

* [fx] remove check.

* [autoparallel] polish docstring.

* [fx] refactor MetaTensor.
```
  1e88811c
- Automated submodule synchronization (#1781) · 2b859502
  github-actions[bot] authored Nov 01, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  2b859502
31 Oct, 2022 1 commit
- [CI] downgrade fbgemm. (#1778) · 5ea89f64
  Super Daniel authored Oct 31, 2022
  
  5ea89f64
28 Oct, 2022 3 commits
- [compatibility] ChunkMgr import error (#1772) · f34dab42
  Jiarui Fang authored Oct 28, 2022
  
  f34dab42
- [autoparallel] add numerical test for handlers (#1769) · a4d1f59c
  YuliangLiu0306 authored Oct 28, 2022
  
  a4d1f59c
- [autoparallel] update CommSpec to CommActions (#1768) · b0f7c8bd
  YuliangLiu0306 authored Oct 28, 2022
```
* [autoparallel] update CommSpec to CommActions

* polish code
```
  b0f7c8bd
27 Oct, 2022 1 commit
- [doc] add FastFold (#1766) · 16b0abf9
  binmakeswell authored Oct 27, 2022
  
  16b0abf9