Commits · a82da26f7e850cd7477c623fabf94814207eaa50 · OpenDAS / ColossalAI

"tests/test_booster/vscode:/vscode.git/clone" did not exist on "46e091651bfa161672c46de5153f2747921a40cd"

25 Apr, 2022 1 commit
- [ci] cache cuda extension (#860) · 1258af71
  Frank Lee authored Apr 25, 2022
  
  1258af71
24 Apr, 2022 7 commits
- [Tensor ] Add 1Drow weight reshard by spec (#854) · bcc86550
  Ziyue Jiang authored Apr 24, 2022
  
  bcc86550
- [Tensor] init a tp network training unittest (#849) · 62f05925
  Jiarui Fang authored Apr 24, 2022
  
  62f05925
- [tensor]add assert for colo_tensor 1Drow (#846) · 2a0a427e
  Ziyue Jiang authored Apr 24, 2022
  
  2a0a427e
- [Tensor] TP Linear 1D row (#843) · 05023ecf
  Ziyue Jiang authored Apr 24, 2022
  
  05023ecf
- [gemini] add GeminiMemoryManger (#832) · e5ea3fde
  HELSON authored Apr 24, 2022
```
* refactor StatefulTensor, tensor utilities

* add unitest for GeminiMemoryManager
```
  e5ea3fde
- [pipelinable]use pipelinable context to initialize non-pipeline model (#816) · 35ea6e10
  YuliangLiu0306 authored Apr 24, 2022
```
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [pipeline]add module lazy init feature to support large model initization.

* [pipeline]add to_layer_list and partition method to support arbitrary non-pp model

* refactor the module structure

* polish

* [pipelinable]add unit test for pipelinable

* polish

* polish

* Fix CodeFactor issues.
```
  35ea6e10
- [hotfix] the bug of numel() in ColoTensor (#845) · ea0a2ed2
  Jiarui Fang authored Apr 24, 2022
  
  ea0a2ed2
22 Apr, 2022 6 commits
- Init Conext supports lazy allocate model memory (#842) · 8789850e
  Jiarui Fang authored Apr 22, 2022
  
  8789850e
- [unittest] refactored unit tests for change in dependency (#838) · 943982d2
  Frank Lee authored Apr 22, 2022
  
  943982d2
- [dependency] removed torchvision (#833) · 01e9f834
  Frank Lee authored Apr 22, 2022
```
* [dependency] removed torchvision

* fixed transforms
```
  01e9f834
- Revert "[WIP] Applying ColoTensor on TP-1D-row Linear. (#831)" (#835) · cb5a4778
  Jiarui Fang authored Apr 22, 2022
```
This reverts commit ac88de6d.
```
  cb5a4778
- [WIP] Applying ColoTensor on TP-1D-row Linear. (#831) · ac88de6d
  Jiarui Fang authored Apr 22, 2022
```
* revert zero tensors back

* [tensor] init row 1d linear
```
  ac88de6d
- [tensor] ZeRO use ColoTensor as the base class. (#828) · 294a6060
  Jiarui Fang authored Apr 22, 2022
```
* [refactor] moving InsertPostInitMethodToModuleSubClasses to utils.

* [tensor] ZeRO use ColoTensor as the base class.

* polish
```
  294a6060
21 Apr, 2022 6 commits

[tensor]fix test_linear (#826) · 8e6fdb4f
Ziyue Jiang authored Apr 21, 2022

8e6fdb4f
[tensor] fix kwargs in colo_tensor torch_funtion (#825) · 1a9e2c2d
Ziyue Jiang authored Apr 21, 2022

1a9e2c2d
[tensor] lazy init (#823) · 2ecc3d7a
Jiarui Fang authored Apr 21, 2022

2ecc3d7a

[Tensor] apply ColoTensor on Torch functions (#821) · 660d2d1f

Jiarui Fang authored Apr 21, 2022

* Revert "[zero] add ZeroTensorShardStrategy (#793)"

This reverts commit 88759e28.

* [gemini] set cpu memory capacity

* [log] local throughput collecting

* polish

* polish

* polish

* polish code

* polish

* polish code

* add a new tensor structure and override linear for it

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* [tensor] renaming and reorganize directory structure.

* rm useless dir

* polish

* polish

* [tensor] hander the function not wrapped

660d2d1f

[tensor] reorganize files (#820) · 0ce8924c
Jiarui Fang authored Apr 21, 2022

0ce8924c

[gemini] a new tensor structure (#818) · ab962b97

Jiarui Fang authored Apr 21, 2022

* Revert "[zero] add ZeroTensorShardStrategy (#793)"

This reverts commit 88759e28.

* [gemini] set cpu memory capacity

* [log] local throughput collecting

* polish

* polish

* polish

* polish code

* polish

* polish code

* add a new tensor structure and override linear for it

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

ab962b97

19 Apr, 2022 4 commits
- Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) · e761ad2c
  Jiarui Fang authored Apr 19, 2022
  
  e761ad2c
- [zero] add ZeroTensorShardStrategy (#793) · 88759e28
  HELSON authored Apr 19, 2022
  
  88759e28
- [refactor] moving grad acc logic to engine (#804) · 681addb5
  Jiarui Fang authored Apr 19, 2022
  
  681addb5
- [refactor] moving memtracer to gemini (#801) · 4d9332b4
  Jiarui Fang authored Apr 19, 2022
  
  4d9332b4
18 Apr, 2022 1 commit
- [hotfix] fix memory leak in zero (#781) · 4c4388c4
  HELSON authored Apr 18, 2022
  
  4c4388c4
14 Apr, 2022 5 commits
- [test] refactored with the new rerun decorator (#763) · 5a1a095b
  Frank Lee authored Apr 15, 2022
```
* [test] refactored with the new rerun decorator

* polish test case
```
  5a1a095b
- [gemini] init genimi individual directory (#754) · 10ef8afd
  Jiarui Fang authored Apr 14, 2022
  
  10ef8afd
- [hotfix] fix test_stateful_tensor_mgr (#762) · dcca614e
  ver217 authored Apr 14, 2022
  
  dcca614e
- [hotfix] fix reuse_fp16_shard of sharded model (#756) · a93a7d73
  ver217 authored Apr 14, 2022
```
* fix reuse_fp16_shard

* disable test stm

* polish code
```
  a93a7d73
- [zero] refactor memstats_collector (#746) · 84c6700b
  HELSON authored Apr 14, 2022
  
  84c6700b
13 Apr, 2022 2 commits
- [zero] add tensor placement policies (#743) · e396bb71
  ver217 authored Apr 13, 2022
```
* add tensor placement policies

* polish comments

* polish comments

* update moe unit tests
```
  e396bb71
- [zero] refactor ShardedParamV2 for convenience (#742) · 22c4b88d
  HELSON authored Apr 13, 2022
  
  22c4b88d
12 Apr, 2022 5 commits
- [bug] fixed DDP compatibility with torch 1.8 (#739) · f4f42d4c
  Frank Lee authored Apr 13, 2022
  
  f4f42d4c
- [utils] correct cpu memory used and capacity in the context of multi-process (#726) · 53cb5848
  Jiarui Fang authored Apr 12, 2022
  
  53cb5848
- [moe] add checkpoint for moe zero test (#729) · b9b469ea
  HELSON authored Apr 12, 2022
  
  b9b469ea
- [test] removed trivial outdated test · e88a498c
  FrankLeeeee authored Apr 12, 2022
  
  e88a498c
- [test] added missing decorators to model checkpointing tests · 62b4ce73
  FrankLeeeee authored Apr 12, 2022
  
  62b4ce73
11 Apr, 2022 3 commits
- [refactor] zero directory (#724) · 4d90a7b5
  Jiarui Fang authored Apr 11, 2022
  
  4d90a7b5
- [bug] fixed broken test_found_inf (#725) · 20ab1f55
  Frank Lee authored Apr 11, 2022
  
  20ab1f55
- [refactor] refactor the memory utils (#715) · 193dc8da
  Jiarui Fang authored Apr 11, 2022
  
  193dc8da