Commits · c2fdc6a011963501dc140d0709d6ba6c5496d7cf · OpenDAS / ColossalAI

16 May, 2022 1 commit
- [tensor] derive compute pattern from dist spec (#971) · c2fdc6a0
  ver217 authored May 16, 2022
```
* derive compute pattern from dist spec

* polish code
```
  c2fdc6a0
14 May, 2022 1 commit
- Automated submodule synchronization (#960) · 46bc9570
  github-actions[bot] authored May 14, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  46bc9570
13 May, 2022 4 commits

add DistSpec for loss and test_model (#947) · 797a9dc5
Ziyue Jiang authored May 13, 2022

797a9dc5

[tensor] design DistSpec and DistSpecManager for ColoTensor (#934) · 67c33f57

ver217 authored May 13, 2022

* add dist spec

* update linear op

* polish code

* polish code

* update embedding op

* polish unit tests

* polish unit tests

* polish comments

* polish code

* add test_dist_spec_mgr

* polish code

* refactor folder structure

* polish unit tests

* add get_process_group() for TensorSpec

* polish code

67c33f57

[Tensor] add optimizer to bert test (#933) · 830d3bca
Ziyue Jiang authored May 13, 2022
```
* add optimizer to bert test

* polish
```
830d3bca
Automated submodule synchronization (#932) · 7edb3819
github-actions[bot] authored May 13, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
7edb3819

11 May, 2022 4 commits

[Tensor] fix init context (#931) · d73c2b1d

Ziyue Jiang authored May 11, 2022

* change torch.Parameter to ColoParameter

* fix post assignment for init context

* polish

* polish

d73c2b1d

[Tensor] simplify named param (#928) · dfc88b85
Ziyue Jiang authored May 11, 2022
```
* simplify ColoModulize

* simplify ColoModulize

* polish

* polish
```
dfc88b85

[pipelinable]use pipelinable to support GPT model. (#903) · 32a45cd7

YuliangLiu0306 authored May 11, 2022

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [pipelinable]use pipelinable to support GPT model.

* fix a bug caused by ShardedModel

* polish

* fix front func list

32a45cd7

Automated submodule synchronization (#929) · b61d6468
github-actions[bot] authored May 11, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
b61d6468

10 May, 2022 1 commit
- [tensor] colo tensor overrides mul (#927) · 4ca73234
  ver217 authored May 10, 2022
```
* colo tensor overrides mul

* polish code
```
  4ca73234
09 May, 2022 4 commits
- [tensor] hijack addmm for colo tensor (#923) · 45b9124d
  ver217 authored May 09, 2022
```
* hijack addmm for colo tensor

* fix bugs

* polish unit test

* polish comments
```
  45b9124d
- test pretrain loading on multi-process (#922) · 534afb01
  Jiarui Fang authored May 09, 2022
  
  534afb01
- [Tensor] add from_pretrained support and bert pretrained test (#921) · c195d281
  Ziyue Jiang authored May 09, 2022
```
* add from_pretrained support and test

* polish

* polish

* polish

* polish
```
  c195d281
- [setup] support more cuda architectures (#920) · 1d625fcd
  ver217 authored May 09, 2022
```
* support more cuda archs

* polish code
```
  1d625fcd
07 May, 2022 3 commits
- update cuda ext cc flags (#919) · 5d8f1262
  ver217 authored May 07, 2022
  
  5d8f1262
- [Graph] building computing graph with ColoTensor, Linear only (#917) · 845856ea
  Jiarui Fang authored May 07, 2022
  
  845856ea
- [Tensor] add 1d vocab loss (#918) · 75d22191
  Ziyue Jiang authored May 07, 2022
```
* add 1d vocab loss

* polish
```
  75d22191
06 May, 2022 6 commits
- [Tensor] fix test_model (#916) · dfaff4e2
  Ziyue Jiang authored May 06, 2022
```
* polish test_model

* polish
```
  dfaff4e2
- [Tensor] polish model test (#915) · ed6426c3
  Jiarui Fang authored May 06, 2022
  
  ed6426c3
- [Tensor] add a basic bert. (#911) · 0fab86b1
  Ziyue Jiang authored May 06, 2022
```
* add base bert test

* Add bert test

* polish

* remove test_bert

* polish
```
  0fab86b1
- [Tensor] init ColoParameter (#914) · ab95ec9a
  Jiarui Fang authored May 06, 2022
  
  ab95ec9a
- update pytest.mark.parametrize in tensor tests (#913) · 193d6293
  Ziyue Jiang authored May 06, 2022
  
  193d6293
- Automated submodule synchronization (#912) · 1cf7fb3c
  github-actions[bot] authored May 06, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  1cf7fb3c
05 May, 2022 2 commits

[ci] added wheel build scripts (#910) · f0f35216

Frank Lee authored May 05, 2022

* [ci] added wheel build scripts

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* polish code and workflow

* [ci] polish wheel build scripts

f0f35216

update local version format (#909) · 150b1a74
ver217 authored May 05, 2022

150b1a74

03 May, 2022 1 commit
- Automated submodule synchronization (#907) · 3b1f5f07
  github-actions[bot] authored May 03, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  3b1f5f07
29 Apr, 2022 1 commit
- [Tensor] add embedding tp1d row (#904) · f593a563
  Ziyue Jiang authored Apr 29, 2022
  
  f593a563
28 Apr, 2022 8 commits
- update release bdist CI (#902) · 16122d5f
  ver217 authored Apr 28, 2022
  
  16122d5f
- [Tensor] add ColoTensor TP1Dcol Embedding (#899) · 2c0d19d7
  Ziyue Jiang authored Apr 28, 2022
  
  2c0d19d7
- add CI for releasing bdist wheel (#901) · e46e423c
  ver217 authored Apr 28, 2022
  
  e46e423c
- change version to 0.1.4 (#900) · e1108caf
  Jiarui Fang authored Apr 28, 2022
  
  e1108caf
- [Tensor] initialize the ColoOptimizer (#898) · d16671da
  Jiarui Fang authored Apr 28, 2022
```
* [Tensor] activation is an attr of ColoTensor

* [Tensor] add optimizer

* only detach parameters in context

* polish code
```
  d16671da
- [Tensor] activation is an attr of ColoTensor (#897) · 676f1915
  Jiarui Fang authored Apr 28, 2022
  
  676f1915
- [Tensor] test parameters() as member function (#896) · e76f76c0
  Jiarui Fang authored Apr 28, 2022
  
  e76f76c0
- [tensor] refine linear and add gather for laynorm (#893) · cb182da7
  Ziyue Jiang authored Apr 28, 2022
```
* refine linear and add function to ColoTensor

* add gather for layernorm

* polish

* polish
```
  cb182da7
27 Apr, 2022 4 commits
- [Tensor] overriding paramters() for Module using ColoTensor (#889) · 26c49639
  Jiarui Fang authored Apr 27, 2022
  
  26c49639
- [setup] add local version label (#890) · daf59ff7
  ver217 authored Apr 27, 2022
  
  daf59ff7
- [tensor] add ColoTensor 1Dcol (#888) · 1d0aba41
  Ziyue Jiang authored Apr 27, 2022
  
  1d0aba41
- [Tensor] test model check results for a simple net (#887) · a0e59716
  Jiarui Fang authored Apr 27, 2022
  
  a0e59716