Commits · 42ab36b7620f8a8b286f237327344239fb3b25a3 · OpenDAS / ColossalAI

07 Jul, 2022 1 commit
- [tensor] torch function return colotensor (#1229) · a98319f0
  Jiarui Fang authored Jul 07, 2022
  
  a98319f0
06 Jul, 2022 1 commit
- [refactor] move process group from _DistSpec to ColoTensor. (#1203) · ae7d3f49
  Jiarui Fang authored Jul 06, 2022
  
  ae7d3f49
04 Jul, 2022 1 commit
- [refactor] remove gpc dependency in colotensor's _ops (#1189) · 060b917d
  Jiarui Fang authored Jul 04, 2022
  
  060b917d
29 Jun, 2022 2 commits
- [tensor] remove gpc in tensor tests (#1186) · c463f8ad
  Jiarui Fang authored Jun 29, 2022
  
  c463f8ad
- [ColoTensor] add independent process group (#1179) · 7487215b
  Jiarui Fang authored Jun 29, 2022
  
  7487215b
24 Jun, 2022 1 commit
- [ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168) · 4b9bba81
  Jiarui Fang authored Jun 24, 2022
  
  4b9bba81
23 Jun, 2022 2 commits
- [Tensor] remove ParallelAction, use ComputeSpec instread (#1166) · f4ef2243
  Jiarui Fang authored Jun 23, 2022
  
  f4ef2243
- remove gather out in parallel action (#1163) · 177c3744
  Jiarui Fang authored Jun 23, 2022
  
  177c3744
09 Jun, 2022 1 commit
- [Tensor] fix equal assert (#1091) · b3a03e4b
  Ziyue Jiang authored Jun 09, 2022
```
* fix equal assert

* polish
```
  b3a03e4b
08 Jun, 2022 1 commit
- [test] ignore 8 gpu test (#1080) · 65ee6dcc
  Frank Lee authored Jun 08, 2022
```
* [test] ignore 8 gpu test

* polish code

* polish workflow

* polish workflow
```
  65ee6dcc
06 Jun, 2022 1 commit
- [refactory] add nn.parallel module (#1068) · 49832b23
  Jiarui Fang authored Jun 06, 2022
  
  49832b23
03 Jun, 2022 1 commit
- reorgnize colotensor directory (#1062) · a0064407
  Jiarui Fang authored Jun 03, 2022
```
* reorgnize colotensor directory

* polish code
```
  a0064407
30 May, 2022 1 commit
- [Tensor] add Parameter inheritance for ColoParameter (#1041) · 7c530b9d
  Ziyue Jiang authored May 30, 2022
```
* add Parameter inheritance for ColoParameter

* remove tricks

* remove tricks

* polish

* polish
```
  7c530b9d
20 May, 2022 1 commit
- [tensor] refactor parallel action (#1007) · a3b66f6d
  ver217 authored May 20, 2022
```
* refactor parallel action

* polish unit tests
```
  a3b66f6d
19 May, 2022 2 commits

[unit test] refactor test tensor (#1005) · 8e3d0ad8
ver217 authored May 19, 2022
```
* polish test_gpt

* update op unit tests

* update test model
```
8e3d0ad8

[tensor] refactor colo-tensor (#992) · ad536e30

ver217 authored May 19, 2022

* refactor colo-tensor and update linear op

* polish code

* polish code

* update ops and unit tests

* update unit tests

* polish code

* rename dist_spec module

* polish code

* polish code

* remove unneeded import

* fix pipelinable

ad536e30

16 May, 2022 1 commit
- [tensor] derive compute pattern from dist spec (#971) · c2fdc6a0
  ver217 authored May 16, 2022
```
* derive compute pattern from dist spec

* polish code
```
  c2fdc6a0
13 May, 2022 3 commits

add DistSpec for loss and test_model (#947) · 797a9dc5
Ziyue Jiang authored May 13, 2022

797a9dc5

[tensor] design DistSpec and DistSpecManager for ColoTensor (#934) · 67c33f57

ver217 authored May 13, 2022

* add dist spec

* update linear op

* polish code

* polish code

* update embedding op

* polish unit tests

* polish unit tests

* polish comments

* polish code

* add test_dist_spec_mgr

* polish code

* refactor folder structure

* polish unit tests

* add get_process_group() for TensorSpec

* polish code

67c33f57

[Tensor] add optimizer to bert test (#933) · 830d3bca
Ziyue Jiang authored May 13, 2022
```
* add optimizer to bert test

* polish
```
830d3bca

11 May, 2022 2 commits

[Tensor] fix init context (#931) · d73c2b1d

Ziyue Jiang authored May 11, 2022

* change torch.Parameter to ColoParameter

* fix post assignment for init context

* polish

* polish

d73c2b1d

[Tensor] simplify named param (#928) · dfc88b85
Ziyue Jiang authored May 11, 2022
```
* simplify ColoModulize

* simplify ColoModulize

* polish

* polish
```
dfc88b85

09 May, 2022 2 commits
- test pretrain loading on multi-process (#922) · 534afb01
  Jiarui Fang authored May 09, 2022
  
  534afb01
- [Tensor] add from_pretrained support and bert pretrained test (#921) · c195d281
  Ziyue Jiang authored May 09, 2022
```
* add from_pretrained support and test

* polish

* polish

* polish

* polish
```
  c195d281
07 May, 2022 2 commits
- [Graph] building computing graph with ColoTensor, Linear only (#917) · 845856ea
  Jiarui Fang authored May 07, 2022
  
  845856ea
- [Tensor] add 1d vocab loss (#918) · 75d22191
  Ziyue Jiang authored May 07, 2022
```
* add 1d vocab loss

* polish
```
  75d22191
06 May, 2022 4 commits
- [Tensor] fix test_model (#916) · dfaff4e2
  Ziyue Jiang authored May 06, 2022
```
* polish test_model

* polish
```
  dfaff4e2
- [Tensor] polish model test (#915) · ed6426c3
  Jiarui Fang authored May 06, 2022
  
  ed6426c3
- [Tensor] add a basic bert. (#911) · 0fab86b1
  Ziyue Jiang authored May 06, 2022
```
* add base bert test

* Add bert test

* polish

* remove test_bert

* polish
```
  0fab86b1
- [Tensor] init ColoParameter (#914) · ab95ec9a
  Jiarui Fang authored May 06, 2022
  
  ab95ec9a
29 Apr, 2022 1 commit
- [Tensor] add embedding tp1d row (#904) · f593a563
  Ziyue Jiang authored Apr 29, 2022
  
  f593a563
28 Apr, 2022 4 commits
- [Tensor] add ColoTensor TP1Dcol Embedding (#899) · 2c0d19d7
  Ziyue Jiang authored Apr 28, 2022
  
  2c0d19d7
- [Tensor] initialize the ColoOptimizer (#898) · d16671da
  Jiarui Fang authored Apr 28, 2022
```
* [Tensor] activation is an attr of ColoTensor

* [Tensor] add optimizer

* only detach parameters in context

* polish code
```
  d16671da
- [Tensor] test parameters() as member function (#896) · e76f76c0
  Jiarui Fang authored Apr 28, 2022
  
  e76f76c0
- [tensor] refine linear and add gather for laynorm (#893) · cb182da7
  Ziyue Jiang authored Apr 28, 2022
```
* refine linear and add function to ColoTensor

* add gather for layernorm

* polish

* polish
```
  cb182da7
27 Apr, 2022 2 commits
- [Tensor] overriding paramters() for Module using ColoTensor (#889) · 26c49639
  Jiarui Fang authored Apr 27, 2022
  
  26c49639
- [Tensor] test model check results for a simple net (#887) · a0e59716
  Jiarui Fang authored Apr 27, 2022
  
  a0e59716
26 Apr, 2022 3 commits
- [Tensor] make a simple net works with 1D row TP (#879) · 7f76517a
  Jiarui Fang authored Apr 26, 2022
  
  7f76517a
- [Tensor] get named parameters for model using ColoTensors (#874) · e43f83aa
  Jiarui Fang authored Apr 26, 2022
  
  e43f83aa
- [tensor] customized op returns ColoTensor (#875) · 96211c2c
  Jiarui Fang authored Apr 26, 2022
```
* [tensor] customized op returns ColoTensor

* polish

* polish code
```
  96211c2c