Commits · 72688adb2f3ff6cc6302d95d7fced8d41d243270 · OpenDAS / ColossalAI

22 May, 2023 1 commit
- [doc] add booster docstring and fix autodoc (#3789) · 72688adb
  Hongxin Liu authored May 22, 2023
```
* [doc] add docstr for booster methods

* [doc] fix autodoc
```
  72688adb
19 May, 2023 7 commits

[plugin] a workaround for zero plugins' optimizer checkpoint (#3780) · 3c07a284

Hongxin Liu authored May 19, 2023

* [test] refactor torch ddp checkpoint test

* [plugin] update low level zero optim checkpoint

* [plugin] update gemini optim checkpoint

3c07a284

[doc] add tutorial for booster checkpoint (#3785) · 60e6a154

Hongxin Liu authored May 19, 2023

* [doc] add checkpoint related docstr for booster

* [doc] add en checkpoint doc

* [doc] add zh checkpoint doc

* [doc] add booster checkpoint doc in sidebar

* [doc] add cuation about ckpt for plugins

* [doc] add doctest placeholder

* [doc] add doctest placeholder

* [doc] add doctest placeholder

60e6a154

[chat] add performance and tutorial (#3786) · ad2cf58f
binmakeswell authored May 19, 2023

ad2cf58f
[devops] fix doc test on pr (#3782) · b4788d63
Hongxin Liu authored May 19, 2023

b4788d63
[NFC] fix typo colossalai/amp auto_parallel autochunk (#3756) · 32f81f14
digger yu authored May 19, 2023

32f81f14

[doc] add tutorial for booster plugins (#3758) · 21e29e22

Hongxin Liu authored May 19, 2023

* [doc] add en booster plugins doc

* [doc] add booster plugins doc in sidebar

* [doc] add zh booster plugins doc

* [doc] fix zh booster plugin translation

* [doc] reoganize tutorials order of basic section

* [devops] force sync to test ci

21e29e22

[doc] add tutorial for cluster utils (#3763) · 5ce6c9d8

Hongxin Liu authored May 19, 2023

* [doc] add en cluster utils doc

* [doc] add zh cluster utils doc

* [doc] add cluster utils doc in sidebar

5ce6c9d8

18 May, 2023 5 commits

[plugin] torch ddp plugin supports sharded model checkpoint (#3775) · 5452df63

Hongxin Liu authored May 18, 2023

* [plugin] torch ddp plugin add save sharded model

* [test] fix torch ddp ckpt io test

* [test] fix torch ddp ckpt io test

* [test] fix low level zero plugin test

* [test] fix low level zero plugin test

* [test] add debug info

* [test] add debug info

* [test] add debug info

* [test] add debug info

* [test] add debug info

* [test] fix low level zero plugin test

* [test] fix low level zero plugin test

* [test] remove debug info

5452df63

[amp] Add naive amp demo (#3774) · 2703a37a
jiangmingyan authored May 18, 2023
```
* [mixed_precison] add naive amp demo

* [mixed_precison] add naive amp demo
```
2703a37a
[doc] update hybrid parallelism doc (#3770) · 48bd0567
jiangmingyan authored May 18, 2023

48bd0567
[auto] fix install cmd (#3772) · 15024e40
binmakeswell authored May 18, 2023

15024e40

[doc] update booster tutorials (#3718) · d449525a

jiangmingyan authored May 18, 2023

* [booster] update booster tutorials#3717

* [booster] update booster tutorials#3717, fix

* [booster] update booster tutorials#3717, update setup doc

* [booster] update booster tutorials#3717, update setup doc

* [booster] update booster tutorials#3717, update setup doc

* [booster] update booster tutorials#3717, update setup doc

* [booster] update booster tutorials#3717, update setup doc

* [booster] update booster tutorials#3717, update setup doc

* [booster] update booster tutorials#3717, rename colossalai booster.md

* [booster] update booster tutorials#3717, rename colossalai booster.md

* [booster] update booster tutorials#3717, rename colossalai booster.md

* [booster] update booster tutorials#3717, fix

* [booster] update booster tutorials#3717, fix

* [booster] update tutorials#3717, update booster api doc

* [booster] update tutorials#3717, modify file

* [booster] update tutorials#3717, modify file

* [booster] update tutorials#3717, modify file

* [booster] update tutorials#3717, modify file

* [booster] update tutorials#3717, modify file

* [booster] update tutorials#3717, modify file

* [booster] update tutorials#3717, modify file

* [booster] update tutorials#3717, fix reference link

* [booster] update tutorials#3717, fix reference link

* [booster] update tutorials#3717, fix reference link

* [booster] update tutorials#3717, fix reference link

* [booster] update tutorials#3717, fix reference link

* [booster] update tutorials#3717, fix reference link

* [booster] update tutorials#3717, fix reference link

* [booster] update tutorials#3713

* [booster] update tutorials#3713, modify file

d449525a

17 May, 2023 4 commits

[chat] fix bugs in stage 3 training (#3759) · 05759839
Yuanchen authored May 17, 2023
```
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>
```
05759839

[devops] fix ci for document check (#3751) · 5dd573c6

Hongxin Liu authored May 17, 2023

* [doc] add test info

* [devops] update doc check ci

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] remove debug info and update invalid doc

* [devops] add essential comments

5dd573c6

[devops] make build on PR run automatically (#3748) · c03bd7c6
Hongxin Liu authored May 17, 2023
```
* [devops] make build on PR run automatically

* [devops] update build on pr condition
```
c03bd7c6
[NFC] fix typo with colossalai/auto_parallel/tensor_shard (#3742) · 1baeb39c
digger yu authored May 17, 2023
```
* fix typo applications/ and colossalai/ date 5.11

* fix typo colossalai/
```
1baeb39c

16 May, 2023 1 commit
- [fix] Add init to fix import error when importing _analyzer (#3668) · 7386c666
  Ziyue Jiang authored May 16, 2023
  
  7386c666
15 May, 2023 4 commits

[booster] removed models that don't support fsdp (#3744) · 6050f377
wukong1992 authored May 15, 2023
```
Co-authored-by: 纪少敏 <jishaomin@jishaomindeMBP.lan>
```
6050f377

[devops] update torch version of CI (#3725) · afb239bb

Hongxin Liu authored May 15, 2023

* [test] fix flop tensor test

* [test] fix autochunk test

* [test] fix lazyinit test

* [devops] update torch version of CI

* [devops] enable testmon

* [devops] fix ci

* [devops] fix ci

* [test] fix checkpoint io test

* [test] fix cluster test

* [test] fix timm test

* [devops] fix ci

* [devops] fix ci

* [devops] fix ci

* [devops] fix ci

* [devops] force sync to test ci

* [test] skip fsdp test

afb239bb

[booster] support torch fsdp plugin in booster (#3697) · b37797ed
wukong1992 authored May 15, 2023
```
Co-authored-by: 纪少敏 <jishaomin@jishaomindeMBP.lan>
```
b37797ed
[NFC] fix typo applications/ and colossalai/ (#3735) · ad6460cf
digger-yu authored May 15, 2023

ad6460cf

11 May, 2023 2 commits

[CI] fix typo with tests/ etc. (#3727) · 1f73609a

digger-yu authored May 11, 2023

* fix spelling error with examples/comminity/

* fix spelling error with tests/

* fix some spelling error with tests/ colossalai/ etc.

* fix spelling error with tests/ etc. date:2023.5.10

1f73609a

[CI] fix typo with tests components (#3695) · 899aa863
digger-yu authored May 11, 2023
```
* fix spelling error with examples/comminity/

* fix spelling error with tests/
```
899aa863

10 May, 2023 3 commits

[CI] fix some spelling errors (#3707) · b7141c36

digger-yu authored May 10, 2023

* fix spelling error with examples/comminity/

* fix spelling error with tests/

* fix some spelling error with tests/ colossalai/ etc.

b7141c36

[chat] fix community example ray (#3719) · f7361ee1
MisterLin1995 authored May 10, 2023
```
Co-authored-by: jiangwen <zxl265370@antgroup.com>
```
f7361ee1

[booster] add tests for ddp and low level zero's checkpointio (#3715) · 20068ba1

jiangmingyan authored May 10, 2023

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update booster tutorials#3717, fix recursive check

20068ba1

09 May, 2023 1 commit

[booster] fix no_sync method (#3709) · 6552cbf8

Hongxin Liu authored May 09, 2023

* [booster] fix no_sync method

* [booster] add test for ddp no_sync

* [booster] fix merge

* [booster] update unit test

* [booster] update unit test

* [booster] update unit test

6552cbf8

08 May, 2023 2 commits

[booster] update prepare dataloader method for plugin (#3706) · 3bf09efe
Hongxin Liu authored May 08, 2023
```
* [booster] add prepare dataloader method for plug

* [booster] update examples and docstr
```
3bf09efe

[example] add train resnet/vit with booster example (#3694) · f83ea813

Hongxin Liu authored May 08, 2023

* [example] add train vit with booster example

* [example] update readme

* [example] add train resnet with booster example

* [example] enable ci

* [example] enable ci

* [example] add requirements

* [hotfix] fix analyzer init

* [example] update requirements

f83ea813

06 May, 2023 4 commits
- [tensor] Refactor handle_trans_spec in DistSpecManager · 2629f971
  YH authored May 06, 2023
  
  2629f971
- [chat] fix train_prompts.py gemini strategy bug (#3666) · 2da5d81d
  zhang-yi-chi authored May 06, 2023
```
* fix gemini strategy bug

* add comment

* add comment

* better solution
```
  2da5d81d
- [example] add finetune bert with booster example (#3693) · d5566488
  Hongxin Liu authored May 06, 2023
  
  d5566488
- fix some spelling error with applications/Chat/examples/ (#3692) · 65bdc315
  digger-yu authored May 06, 2023
```
* fix spelling error with examples/comminity/

* fix spelling error with example/
```
  65bdc315
05 May, 2023 6 commits

[booster] refactor all dp fashion plugins (#3684) · d0915f54

Hongxin Liu authored May 05, 2023

* [booster] add dp plugin base

* [booster] inherit dp plugin base

* [booster] refactor unit tests

d0915f54

[CI] Update test_sharded_optim_with_sync_bn.py (#3688) · b49020c1
digger-yu authored May 05, 2023
```
fix spelling error in line23
change "cudnn_determinstic"=True to "cudnn_deterministic=True"
```
b49020c1
Merge pull request #3680 from digger-yu/digger-yu-patch-2 · b36e67cb
Tong Li authored May 05, 2023
```
fix spelling error with applications/Chat/evaluate/
```
b36e67cb

[booster] gemini plugin support shard checkpoint (#3610) · 307894f7

jiangmingyan authored May 05, 2023



* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

---------
Co-authored-by: luchen <luchen@luchendeMBP.lan>
Co-authored-by: luchen <luchen@luchendeMacBook-Pro.local>

307894f7

[chat] PPO stage3 doc enhancement (#3679) · 0f785cb1

Camille Zhong authored May 05, 2023

* Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894dcbe958acd4e10d771f22275e20e368.

Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

Update test_ci.sh

Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894dcbe958acd4e10d771f22275e20e368.

Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

Update test_ci.sh

Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

update roberta with coati

chat ci update

Revert "chat ci update"

This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846.

* Update README.md

Update README.md

* update readme

* Update test_ci.sh

* update readme and add a script

update readme and add a script

modify readme

Update README.md

0f785cb1

[doc] fix chat spelling error (#3671) · 6650daeb

digger-yu authored May 05, 2023

* Update README.md

change "huggingaface" to "huggingface"

* Update README.md

change "Colossa-AI" to "Colossal-AI"

6650daeb