Commits · 5dd573c6b6dcb37f1505ae2306a63e2ea4d388d0 · OpenDAS / ColossalAI

17 May, 2023 3 commits

[devops] fix ci for document check (#3751) · 5dd573c6

Hongxin Liu authored May 17, 2023

* [doc] add test info

* [devops] update doc check ci

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] add debug info

* [devops] remove debug info and update invalid doc

* [devops] add essential comments

5dd573c6

[devops] make build on PR run automatically (#3748) · c03bd7c6
Hongxin Liu authored May 17, 2023
```
* [devops] make build on PR run automatically

* [devops] update build on pr condition
```
c03bd7c6
[NFC] fix typo with colossalai/auto_parallel/tensor_shard (#3742) · 1baeb39c
digger yu authored May 17, 2023
```
* fix typo applications/ and colossalai/ date 5.11

* fix typo colossalai/
```
1baeb39c

16 May, 2023 1 commit
- [fix] Add init to fix import error when importing _analyzer (#3668) · 7386c666
  Ziyue Jiang authored May 16, 2023
  
  7386c666
15 May, 2023 4 commits

[booster] removed models that don't support fsdp (#3744) · 6050f377
wukong1992 authored May 15, 2023
```
Co-authored-by: 纪少敏 <jishaomin@jishaomindeMBP.lan>
```
6050f377

[devops] update torch version of CI (#3725) · afb239bb

Hongxin Liu authored May 15, 2023

* [test] fix flop tensor test

* [test] fix autochunk test

* [test] fix lazyinit test

* [devops] update torch version of CI

* [devops] enable testmon

* [devops] fix ci

* [devops] fix ci

* [test] fix checkpoint io test

* [test] fix cluster test

* [test] fix timm test

* [devops] fix ci

* [devops] fix ci

* [devops] fix ci

* [devops] fix ci

* [devops] force sync to test ci

* [test] skip fsdp test

afb239bb

[booster] support torch fsdp plugin in booster (#3697) · b37797ed
wukong1992 authored May 15, 2023
```
Co-authored-by: 纪少敏 <jishaomin@jishaomindeMBP.lan>
```
b37797ed
[NFC] fix typo applications/ and colossalai/ (#3735) · ad6460cf
digger-yu authored May 15, 2023

ad6460cf

11 May, 2023 2 commits

[CI] fix typo with tests/ etc. (#3727) · 1f73609a

digger-yu authored May 11, 2023

* fix spelling error with examples/comminity/

* fix spelling error with tests/

* fix some spelling error with tests/ colossalai/ etc.

* fix spelling error with tests/ etc. date:2023.5.10

1f73609a

[CI] fix typo with tests components (#3695) · 899aa863
digger-yu authored May 11, 2023
```
* fix spelling error with examples/comminity/

* fix spelling error with tests/
```
899aa863

10 May, 2023 3 commits

[CI] fix some spelling errors (#3707) · b7141c36

digger-yu authored May 10, 2023

* fix spelling error with examples/comminity/

* fix spelling error with tests/

* fix some spelling error with tests/ colossalai/ etc.

b7141c36

[chat] fix community example ray (#3719) · f7361ee1
MisterLin1995 authored May 10, 2023
```
Co-authored-by: jiangwen <zxl265370@antgroup.com>
```
f7361ee1

[booster] add tests for ddp and low level zero's checkpointio (#3715) · 20068ba1

jiangmingyan authored May 10, 2023

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update tests for booster

* [booster] update booster tutorials#3717, fix recursive check

20068ba1

09 May, 2023 1 commit

[booster] fix no_sync method (#3709) · 6552cbf8

Hongxin Liu authored May 09, 2023

* [booster] fix no_sync method

* [booster] add test for ddp no_sync

* [booster] fix merge

* [booster] update unit test

* [booster] update unit test

* [booster] update unit test

6552cbf8

08 May, 2023 2 commits

[booster] update prepare dataloader method for plugin (#3706) · 3bf09efe
Hongxin Liu authored May 08, 2023
```
* [booster] add prepare dataloader method for plug

* [booster] update examples and docstr
```
3bf09efe

[example] add train resnet/vit with booster example (#3694) · f83ea813

Hongxin Liu authored May 08, 2023

* [example] add train vit with booster example

* [example] update readme

* [example] add train resnet with booster example

* [example] enable ci

* [example] enable ci

* [example] add requirements

* [hotfix] fix analyzer init

* [example] update requirements

f83ea813

06 May, 2023 4 commits
- [tensor] Refactor handle_trans_spec in DistSpecManager · 2629f971
  YH authored May 06, 2023
  
  2629f971
- [chat] fix train_prompts.py gemini strategy bug (#3666) · 2da5d81d
  zhang-yi-chi authored May 06, 2023
```
* fix gemini strategy bug

* add comment

* add comment

* better solution
```
  2da5d81d
- [example] add finetune bert with booster example (#3693) · d5566488
  Hongxin Liu authored May 06, 2023
  
  d5566488
- fix some spelling error with applications/Chat/examples/ (#3692) · 65bdc315
  digger-yu authored May 06, 2023
```
* fix spelling error with examples/comminity/

* fix spelling error with example/
```
  65bdc315
05 May, 2023 6 commits

[booster] refactor all dp fashion plugins (#3684) · d0915f54

Hongxin Liu authored May 05, 2023

* [booster] add dp plugin base

* [booster] inherit dp plugin base

* [booster] refactor unit tests

d0915f54

[CI] Update test_sharded_optim_with_sync_bn.py (#3688) · b49020c1
digger-yu authored May 05, 2023
```
fix spelling error in line23
change "cudnn_determinstic"=True to "cudnn_deterministic=True"
```
b49020c1
Merge pull request #3680 from digger-yu/digger-yu-patch-2 · b36e67cb
Tong Li authored May 05, 2023
```
fix spelling error with applications/Chat/evaluate/
```
b36e67cb

[booster] gemini plugin support shard checkpoint (#3610) · 307894f7

jiangmingyan authored May 05, 2023



* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin add shard checkpoint save/load

* gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

* [API Refactoring]gemini plugin support shard checkpoint

---------
Co-authored-by: luchen <luchen@luchendeMBP.lan>
Co-authored-by: luchen <luchen@luchendeMacBook-Pro.local>

307894f7

[chat] PPO stage3 doc enhancement (#3679) · 0f785cb1

Camille Zhong authored May 05, 2023

* Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894dcbe958acd4e10d771f22275e20e368.

Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

Update test_ci.sh

Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894dcbe958acd4e10d771f22275e20e368.

Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

Update test_ci.sh

Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

update roberta with coati

chat ci update

Revert "chat ci update"

This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846.

* Update README.md

Update README.md

* update readme

* Update test_ci.sh

* update readme and add a script

update readme and add a script

modify readme

Update README.md

0f785cb1

[doc] fix chat spelling error (#3671) · 6650daeb

digger-yu authored May 05, 2023

* Update README.md

change "huggingaface" to "huggingface"

* Update README.md

change "Colossa-AI" to "Colossal-AI"

6650daeb

04 May, 2023 3 commits
- [chat] add opt attn kernel (#3655) · 7bd0bee8
  Hongxin Liu authored May 04, 2023
```
* [chat] add opt attn kernel

* [chat] disable xformer during fwd
```
  7bd0bee8
- Update generate_gpt35_answers.py · 8ba78587
  digger-yu authored May 04, 2023
```
fix spelling error with generate_gpt35_answers.py
```
  8ba78587
- fix spelling error · bfbf6505
  digger-yu authored May 04, 2023
```
fix spelling error with evaluate.py
```
  bfbf6505
28 Apr, 2023 5 commits
- [chat] typo accimulation_steps -> accumulation_steps (#3662) · 1a60dc07
  tanitna authored Apr 28, 2023
  
  1a60dc07
- Merge pull request #3656 from TongLi3701/chat/update_eval · 816add7e
  Tong Li authored Apr 28, 2023
```
[Chat]: Remove unnecessary step and update documentation
```
  816add7e
- [chat] set default zero2 strategy (#3667) · 268b3cd8
  binmakeswell authored Apr 28, 2023
```
* [chat] set default gemini strategy

* [chat] set default zero2 strategy

* [chat] set default zero2 strategy
```
  268b3cd8
- update readme · c1a35594
  Tong Li authored Apr 28, 2023
  
  c1a35594
- update documentation · ed3eaa69
  Tong Li authored Apr 28, 2023
  
  ed3eaa69
27 Apr, 2023 6 commits

update questions and readme · c4191173
Tong Li authored Apr 27, 2023

c4191173
remove unnecessary step and update readme · aa77ddae
Tong Li authored Apr 27, 2023

aa77ddae
[zero] Suggests a minor change to confusing variable names in the ZeRO optimizer. (#3173) · a22407cc
YH authored Apr 27, 2023
```
* Fix confusing variable name in zero opt

* Apply lint

* Fix util func

* Fix minor util func

* Fix zero param optimizer name
```
a22407cc

[chat] refactor model save/load logic (#3654) · 842768a1

Hongxin Liu authored Apr 27, 2023

* [chat] strategy refactor unwrap model

* [chat] strategy refactor save model

* [chat] add docstr

* [chat] refactor trainer save model

* [chat] fix strategy typing

* [chat] refactor trainer save model

* [chat] update readme

* [chat] fix unit test

842768a1

[chat] remove lm model class (#3653) · 6ef70114

Hongxin Liu authored Apr 27, 2023

* [chat] refactor lora

* [chat] remove lm class

* [chat] refactor save model

* [chat] refactor train sft

* [chat] fix ci

* [chat] fix ci

6ef70114

[Doc] enhancement on README.md for chat examples (#3646) · 8bccb72c

Camille Zhong authored Apr 27, 2023

* Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894dcbe958acd4e10d771f22275e20e368.

Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

Update test_ci.sh

Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894dcbe958acd4e10d771f22275e20e368.

Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

Update test_ci.sh

Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

update roberta with coati

chat ci update

Revert "chat ci update"

This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846.

* Update README.md

Update README.md

* update readme

* Update test_ci.sh

8bccb72c