Commits · f593a5637ef8b66035720ad615df10dfda369b53 · OpenDAS / ColossalAI

29 Apr, 2022 1 commit
- [Tensor] add embedding tp1d row (#904) · f593a563
  Ziyue Jiang authored Apr 29, 2022
  
  f593a563
28 Apr, 2022 8 commits
- update release bdist CI (#902) · 16122d5f
  ver217 authored Apr 28, 2022
  
  16122d5f
- [Tensor] add ColoTensor TP1Dcol Embedding (#899) · 2c0d19d7
  Ziyue Jiang authored Apr 28, 2022
  
  2c0d19d7
- add CI for releasing bdist wheel (#901) · e46e423c
  ver217 authored Apr 28, 2022
  
  e46e423c
- change version to 0.1.4 (#900) · e1108caf
  Jiarui Fang authored Apr 28, 2022
  
  e1108caf
- [Tensor] initialize the ColoOptimizer (#898) · d16671da
  Jiarui Fang authored Apr 28, 2022
```
* [Tensor] activation is an attr of ColoTensor

* [Tensor] add optimizer

* only detach parameters in context

* polish code
```
  d16671da
- [Tensor] activation is an attr of ColoTensor (#897) · 676f1915
  Jiarui Fang authored Apr 28, 2022
  
  676f1915
- [Tensor] test parameters() as member function (#896) · e76f76c0
  Jiarui Fang authored Apr 28, 2022
  
  e76f76c0
- [tensor] refine linear and add gather for laynorm (#893) · cb182da7
  Ziyue Jiang authored Apr 28, 2022
```
* refine linear and add function to ColoTensor

* add gather for layernorm

* polish

* polish
```
  cb182da7
27 Apr, 2022 5 commits
- [Tensor] overriding paramters() for Module using ColoTensor (#889) · 26c49639
  Jiarui Fang authored Apr 27, 2022
  
  26c49639
- [setup] add local version label (#890) · daf59ff7
  ver217 authored Apr 27, 2022
  
  daf59ff7
- [tensor] add ColoTensor 1Dcol (#888) · 1d0aba41
  Ziyue Jiang authored Apr 27, 2022
  
  1d0aba41
- [Tensor] test model check results for a simple net (#887) · a0e59716
  Jiarui Fang authored Apr 27, 2022
  
  a0e59716
- [Tensor] make ColoTensor more robust for getattr (#886) · 72cdc068
  Jiarui Fang authored Apr 27, 2022
```
* [Tensor] make ColoTensor more robust for getattr

* polish

* polish
```
  72cdc068
26 Apr, 2022 13 commits
- [tensor] wrap function in the torch_tensor to ColoTensor (#881) · 9bc5a77c
  Ziyue Jiang authored Apr 26, 2022
  
  9bc5a77c
- fix import error (#880) · 4df6471f
  ver217 authored Apr 26, 2022
  
  4df6471f
- [Tensor] make a simple net works with 1D row TP (#879) · 7f76517a
  Jiarui Fang authored Apr 26, 2022
  
  7f76517a
- [gemini] accelerate adjust_layout() (#878) · c4d903e6
  ver217 authored Apr 26, 2022
```
* add lru cache

* polish code

* update unit test

* fix sharded optim
```
  c4d903e6
- [Tensor] Add some attributes to ColoTensor (#877) · 90921145
  Jiarui Fang authored Apr 26, 2022
```
* [Tensor] add some function to ColoTensor

* torch.allclose

* rm torch.add
```
  90921145
- [gemini] polish stateful_tensor_mgr (#876) · 425b4a96
  HELSON authored Apr 26, 2022
  
  425b4a96
- [Tensor] get named parameters for model using ColoTensors (#874) · e43f83aa
  Jiarui Fang authored Apr 26, 2022
  
  e43f83aa
- [example] change qkv processing (#870) · 28830402
  LuGY authored Apr 26, 2022
  
  28830402
- [tensor] customized op returns ColoTensor (#875) · 96211c2c
  Jiarui Fang authored Apr 26, 2022
```
* [tensor] customized op returns ColoTensor

* polish

* polish code
```
  96211c2c
- [Tensor] Add function to spec and update linear 1Drow and unit tests (#869) · 26d4ab8b
  Ziyue Jiang authored Apr 26, 2022
  
  26d4ab8b
- [doc] improved docstring and assertion messages for the engine module (#871) · 11f54c7b
  Frank Lee authored Apr 26, 2022
  
  11f54c7b
- [doc] improved assertion messages in trainer (#873) · 1c343826
  Frank Lee authored Apr 26, 2022
  
  1c343826
- [doc] improved error messages in initialize (#872) · 7a64fae3
  Frank Lee authored Apr 26, 2022
  
  7a64fae3
25 Apr, 2022 13 commits
- [tensor] add cross_entrophy_loss (#868) · 1190b2c4
  Jiarui Fang authored Apr 25, 2022
  
  1190b2c4
- [gemini] add stateful tensor container (#867) · 31078171
  HELSON authored Apr 25, 2022
  
  31078171
- colo init context add device attr. (#866) · d01d3b8c
  Jiarui Fang authored Apr 25, 2022
  
  d01d3b8c
- [usability] improved error messages in the context module (#856) · 2238758c
  Frank Lee authored Apr 25, 2022
  
  2238758c
- [doc] improved docstring in the amp module (#857) · 9fdebadd
  Frank Lee authored Apr 25, 2022
  
  9fdebadd
- [doc] improved docstring in the logging module (#861) · b862d89d
  Frank Lee authored Apr 25, 2022
  
  b862d89d
- [doc] improved docstring in the communication module (#863) · 8004c8e9
  Frank Lee authored Apr 25, 2022
  
  8004c8e9
- [tensor] an initial dea of tensor spec (#865) · 8af5f742
  Jiarui Fang authored Apr 25, 2022
```
* a initial dea of tensor spec

* polish

* polish
```
  8af5f742
- [Tensor] add layer norm Op (#852) · 126ba573
  Jiarui Fang authored Apr 25, 2022
  
  126ba573
- [cli] refactored micro-benchmarking cli and added more metrics (#858) · a82da26f
  Frank Lee authored Apr 25, 2022
  
  a82da26f
- [usability] added assertion message in registry (#864) · ee222dfb
  Frank Lee authored Apr 25, 2022
  
  ee222dfb
- [gemini] polish code (#855) · f0e65455
  HELSON authored Apr 25, 2022
  
  f0e65455
- hotfix tensor unittest bugs (#862) · 29159d9b
  Jiarui Fang authored Apr 25, 2022
  
  29159d9b