Commits · 0c51ff2c135d911b0b1b250c6db9d367a18bc98d · OpenDAS / ColossalAI

18 Jul, 2022 1 commit

[hotfix] ZeroDDP use new process group (#1333) · 0c51ff2c

ver217 authored Jul 18, 2022

* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests

0c51ff2c

15 Jul, 2022 1 commit
- [hotfix] shared model returns cpu state_dict (#1328) · 7a053671
  ver217 authored Jul 15, 2022
  
  7a053671
04 Jul, 2022 1 commit
- [refactor] remove gpc dependency in colotensor's _ops (#1189) · 060b917d
  Jiarui Fang authored Jul 04, 2022
  
  060b917d
29 Jun, 2022 1 commit
- [refactor] move chunk and chunkmgr to directory gemini (#1182) · 372f7914
  Jiarui Fang authored Jun 29, 2022
  
  372f7914
24 Jun, 2022 2 commits
- [zero] sharded optim supports loading local state dict (#1170) · 9e1daa63
  ver217 authored Jun 24, 2022
```
* sharded optim supports loading local state dict

* polish code

* add unit test
```
  9e1daa63
- [zero] zero optim supports loading local state dict (#1171) · 561e9049
  ver217 authored Jun 24, 2022
```
* zero optim supports loading local state dict

* polish code

* add unit test
```
  561e9049
08 Jun, 2022 1 commit
- [test] ignore 8 gpu test (#1080) · 65ee6dcc
  Frank Lee authored Jun 08, 2022
```
* [test] ignore 8 gpu test

* polish code

* polish workflow

* polish workflow
```
  65ee6dcc
24 Apr, 2022 1 commit
- [gemini] add GeminiMemoryManger (#832) · e5ea3fde
  HELSON authored Apr 24, 2022
```
* refactor StatefulTensor, tensor utilities

* add unitest for GeminiMemoryManager
```
  e5ea3fde
19 Apr, 2022 3 commits
- Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) · e761ad2c
  Jiarui Fang authored Apr 19, 2022
  
  e761ad2c
- [zero] add ZeroTensorShardStrategy (#793) · 88759e28
  HELSON authored Apr 19, 2022
  
  88759e28
- [refactor] moving memtracer to gemini (#801) · 4d9332b4
  Jiarui Fang authored Apr 19, 2022
  
  4d9332b4
18 Apr, 2022 1 commit
- [hotfix] fix memory leak in zero (#781) · 4c4388c4
  HELSON authored Apr 18, 2022
  
  4c4388c4
14 Apr, 2022 5 commits
- [test] refactored with the new rerun decorator (#763) · 5a1a095b
  Frank Lee authored Apr 15, 2022
```
* [test] refactored with the new rerun decorator

* polish test case
```
  5a1a095b
- [gemini] init genimi individual directory (#754) · 10ef8afd
  Jiarui Fang authored Apr 14, 2022
  
  10ef8afd
- [hotfix] fix test_stateful_tensor_mgr (#762) · dcca614e
  ver217 authored Apr 14, 2022
  
  dcca614e
- [hotfix] fix reuse_fp16_shard of sharded model (#756) · a93a7d73
  ver217 authored Apr 14, 2022
```
* fix reuse_fp16_shard

* disable test stm

* polish code
```
  a93a7d73
- [zero] refactor memstats_collector (#746) · 84c6700b
  HELSON authored Apr 14, 2022
  
  84c6700b
13 Apr, 2022 2 commits
- [zero] add tensor placement policies (#743) · e396bb71
  ver217 authored Apr 13, 2022
```
* add tensor placement policies

* polish comments

* polish comments

* update moe unit tests
```
  e396bb71
- [zero] refactor ShardedParamV2 for convenience (#742) · 22c4b88d
  HELSON authored Apr 13, 2022
  
  22c4b88d
12 Apr, 2022 2 commits
- [bug] fixed DDP compatibility with torch 1.8 (#739) · f4f42d4c
  Frank Lee authored Apr 13, 2022
  
  f4f42d4c
- [utils] correct cpu memory used and capacity in the context of multi-process (#726) · 53cb5848
  Jiarui Fang authored Apr 12, 2022
  
  53cb5848