Commits · c2fdc6a011963501dc140d0709d6ba6c5496d7cf · OpenDAS / ColossalAI

16 May, 2022 1 commit
- [tensor] derive compute pattern from dist spec (#971) · c2fdc6a0
  ver217 authored May 16, 2022
```
* derive compute pattern from dist spec

* polish code
```
  c2fdc6a0
13 May, 2022 1 commit

[tensor] design DistSpec and DistSpecManager for ColoTensor (#934) · 67c33f57

ver217 authored May 13, 2022

* add dist spec

* update linear op

* polish code

* polish code

* update embedding op

* polish unit tests

* polish unit tests

* polish comments

* polish code

* add test_dist_spec_mgr

* polish code

* refactor folder structure

* polish unit tests

* add get_process_group() for TensorSpec

* polish code

67c33f57

06 May, 2022 1 commit
- update pytest.mark.parametrize in tensor tests (#913) · 193d6293
  Ziyue Jiang authored May 06, 2022
  
  193d6293
28 Apr, 2022 2 commits
- [Tensor] add ColoTensor TP1Dcol Embedding (#899) · 2c0d19d7
  Ziyue Jiang authored Apr 28, 2022
  
  2c0d19d7
- [tensor] refine linear and add gather for laynorm (#893) · cb182da7
  Ziyue Jiang authored Apr 28, 2022
```
* refine linear and add function to ColoTensor

* add gather for layernorm

* polish

* polish
```
  cb182da7
27 Apr, 2022 1 commit
- [tensor] add ColoTensor 1Dcol (#888) · 1d0aba41
  Ziyue Jiang authored Apr 27, 2022
  
  1d0aba41
26 Apr, 2022 1 commit
- [Tensor] Add function to spec and update linear 1Drow and unit tests (#869) · 26d4ab8b
  Ziyue Jiang authored Apr 26, 2022
  
  26d4ab8b
24 Apr, 2022 4 commits
- [Tensor ] Add 1Drow weight reshard by spec (#854) · bcc86550
  Ziyue Jiang authored Apr 24, 2022
  
  bcc86550
- [Tensor] init a tp network training unittest (#849) · 62f05925
  Jiarui Fang authored Apr 24, 2022
  
  62f05925
- [tensor]add assert for colo_tensor 1Drow (#846) · 2a0a427e
  Ziyue Jiang authored Apr 24, 2022
  
  2a0a427e
- [Tensor] TP Linear 1D row (#843) · 05023ecf
  Ziyue Jiang authored Apr 24, 2022
  
  05023ecf
22 Apr, 2022 2 commits
- Revert "[WIP] Applying ColoTensor on TP-1D-row Linear. (#831)" (#835) · cb5a4778
  Jiarui Fang authored Apr 22, 2022
```
This reverts commit ac88de6d.
```
  cb5a4778
- [WIP] Applying ColoTensor on TP-1D-row Linear. (#831) · ac88de6d
  Jiarui Fang authored Apr 22, 2022
```
* revert zero tensors back

* [tensor] init row 1d linear
```
  ac88de6d