Commits · 7c96055c688902af32bb3871232f7e9dda608a1d · OpenDAS / ColossalAI

"examples/vscode:/vscode.git/clone" did not exist on "2d1a7dfe5f9f469ee75ec9c1a17f129766751fbb"

08 Aug, 2022 1 commit
- [tensor]build sharding spec to replace distspec in future. (#1405) · 7c96055c
  YuliangLiu0306 authored Aug 08, 2022
  
  7c96055c
05 Aug, 2022 1 commit
- [hotfix] fix CPUAdam kernel nullptr (#1410) · 12b48870
  ver217 authored Aug 05, 2022
  
  12b48870
03 Aug, 2022 1 commit
- Automated submodule synchronization (#1396) · 1e5eb087
  github-actions[bot] authored Aug 03, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  1e5eb087
02 Aug, 2022 5 commits
- [device] add DeviceMesh class to support logical device layout (#1394) · 0442f940
  YuliangLiu0306 authored Aug 02, 2022
```
* [device] add DeviceMesh class to support logical device layout

* polish code

* add doc string
```
  0442f940
- [zero] ZeroDDP supports controlling outputs' dtype (#1399) · 04c9a86a
  ver217 authored Aug 02, 2022
  
  04c9a86a
- [zero] alleviate memory usage in ZeRODDP state_dict (#1398) · 4e98e938
  HELSON authored Aug 02, 2022
  
  4e98e938
- update nvme on readme (#1397) · 4f5f8f77
  Jiarui Fang authored Aug 02, 2022
  
  4f5f8f77
- [zero] chunk manager allows filtering ex-large params (#1393) · 56b8863b
  ver217 authored Aug 02, 2022
  
  56b8863b
01 Aug, 2022 2 commits
- [fx] fixed torchaudio conformer tracing (#1392) · adf5054f
  Frank Lee authored Aug 01, 2022
  
  adf5054f
- [fx] patched torch.max and data movement operator (#1391) · 7d629392
  Frank Lee authored Aug 01, 2022
```
* [fx] patched torch.max and data movement operator

* polish code
```
  7d629392
30 Jul, 2022 1 commit
- Update README.md · db89600c
  fastalgo authored Jul 30, 2022
  
  db89600c
29 Jul, 2022 6 commits
- [fx] fixed indentation error in checkpointing codegen (#1385) · 89e60d15
  Frank Lee authored Jul 30, 2022
  
  89e60d15
- [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) · c7221cb2
  HELSON authored Jul 29, 2022
  
  c7221cb2
- [fx] patched torch.full for huggingface opt (#1386) · ad678921
  Frank Lee authored Jul 29, 2022
  
  ad678921
- [hotfix] fix a running error in test_colo_checkpoint.py (#1387) · 527758b2
  HELSON authored Jul 29, 2022
  
  527758b2
- [chunk] add PG check for tensor appending (#1383) · f792507f
  Jiarui Fang authored Jul 29, 2022
  
  f792507f
- [zero] zero optim state_dict takes only_rank_0 (#1384) · 8dced41a
  ver217 authored Jul 29, 2022
```
* zero optim state_dict takes only_rank_0

* fix unit test
```
  8dced41a
28 Jul, 2022 8 commits
- [DDP] test ddp state dict uses more strict threshold (#1382) · 7d5d628e
  ver217 authored Jul 28, 2022
  
  7d5d628e
- [hotfix] fix some bugs during gpt2 testing (#1379) · df544814
  YuliangLiu0306 authored Jul 28, 2022
  
  df544814
- [hotfix] fix zero optim save/load state dict (#1381) · 828b9e5e
  ver217 authored Jul 28, 2022
  
  828b9e5e
- [checkpoint] add kwargs for load_state_dict (#1374) · b6fd165f
  HELSON authored Jul 28, 2022
  
  b6fd165f
- Automated submodule synchronization (#1380) · 50dec605
  github-actions[bot] authored Jul 28, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  50dec605
- [hotfix] fix zero ddp buffer cast (#1376) · 83328329
  ver217 authored Jul 28, 2022
```
* fix zero ddp buffer cast

* fix zero ddp ignore params
```
  83328329
- fix zero ddp state dict (#1378) · 5d5031e9
  ver217 authored Jul 28, 2022
  
  5d5031e9
- [util] standard checkpoint function naming (#1377) · 0c1a16ea
  Frank Lee authored Jul 28, 2022
  
  0c1a16ea
27 Jul, 2022 3 commits

[fx] update split module pass and add customized policy (#1373) · 52bc2dc2

YuliangLiu0306 authored Jul 27, 2022

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx]update split module pass and add customized policy

52bc2dc2

[fx] add torchaudio test (#1369) · be229217

Super Daniel authored Jul 27, 2022

* [fx]add torchaudio test

* [fx]add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test

* [fx] add torchaudio test and test patches

* Delete ~

* [fx] add patches and patches test

* [fx] add patches and patches test

* [fx] fix patches

* [fx] fix rnn patches

* [fx] fix rnn patches

* [fx] fix rnn patches

* [fx] fix rnn patches

* [fx] merge upstream

* [fx] fix import errors

be229217

Automated submodule synchronization (#1372) · fb6f0859
github-actions[bot] authored Jul 27, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
fb6f0859

26 Jul, 2022 7 commits
- [fx] Add colotracer compatibility test on torchrec (#1370) · bb640ec7
  Boyuan Yao authored Jul 26, 2022
  
  bb640ec7
- [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) · c415240d
  ver217 authored Jul 26, 2022
```
* impl nvme optimizer

* update cpu adam

* add unit test

* update hybrid adam

* update docstr

* add TODOs

* update CI

* fix CI

* fix CI

* fix CI path

* fix CI path

* fix CI path

* fix install tensornvme

* fix CI

* fix CI path

* fix CI env variables

* test CI

* test CI

* fix CI

* fix nvme optim __del__

* fix adam __del__

* fix nvme optim

* fix CI env variables

* fix nvme optim import

* test CI

* test CI

* fix CI
```
  c415240d
- [checkpoint] use args, kwargs in save_checkpoint, load_checkpoint (#1368) · 84632906
  HELSON authored Jul 26, 2022
  
  84632906
- Automated submodule synchronization (#1364) · c491c2a9
  github-actions[bot] authored Jul 26, 2022
```
Co-authored-by: github-actions <github-actions@github.com>
```
  c491c2a9
- [fx]add gpt2 passes for pipeline performance test (#1366) · 55428166
  YuliangLiu0306 authored Jul 26, 2022
```
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx]add gpt2 passes for pipeline performance test
```
  55428166
- [colotensor] use cpu memory to store state_dict (#1367) · 87775a06
  HELSON authored Jul 26, 2022
  
  87775a06
- [hotfix] fix no optimizer in save/load (#1363) · 943a9632
  HELSON authored Jul 26, 2022
  
  943a9632
25 Jul, 2022 4 commits
- [fx] added activation checkpoint codegen support for torch < 1.12 (#1359) · cd063ac3
  Frank Lee authored Jul 25, 2022
  
  cd063ac3
- [unit test] add megatron init test in zero_optim (#1358) · 44178041
  HELSON authored Jul 25, 2022
  
  44178041
- [hotfix] fix megatron_init in test_gpt2.py (#1357) · 7a065dc9
  HELSON authored Jul 25, 2022
  
  7a065dc9
- [fx] added activation checkpoint codegen (#1355) · 644582ee
  Frank Lee authored Jul 25, 2022
  
  644582ee
21 Jul, 2022 1 commit
- [docker] add tensornvme in docker (#1354) · 38fd8844
  ver217 authored Jul 21, 2022
```
* add tensornvme in docker

* fix dockerfile

* fix dockerfile
```
  38fd8844