Commits · 06db94fbc98e5f21dedd1199370bcf6ec4bd00d5 · OpenDAS / ColossalAI

"examples/vscode:/vscode.git/clone" did not exist on "405222ce6053ef89103842a0db5cb71419cec50c"

08 Feb, 2024 1 commit
- [moe] fix tests · 06db94fb
  ver217 authored Feb 08, 2024
  
  06db94fb
07 Feb, 2024 6 commits

[moe] fix mixtral optim checkpoint (#5344) · 65e5d6ba
Hongxin Liu authored Feb 01, 2024

65e5d6ba
[moe] fix mixtral forward default value (#5329) · 956b561b
Hongxin Liu authored Jan 30, 2024

956b561b
[moe] fix mixtral checkpoint io (#5314) · b60be18d
Hongxin Liu authored Jan 27, 2024

b60be18d

[moe] support mixtral (#5309) · da39d21b

Hongxin Liu authored Jan 25, 2024

* [moe] add mixtral block for single expert

* [moe] mixtral block fwd support uneven ep

* [moe] mixtral block bwd support uneven ep

* [moe] add mixtral moe layer

* [moe] simplify replace

* [meo] support save sharded mixtral

* [meo] support load sharded mixtral

* [meo] support save sharded optim

* [meo] integrate moe manager into plug

* [meo] fix optimizer load

* [meo] fix mixtral layer

da39d21b

[moe] update capacity computing (#5253) · c904d2ae

Hongxin Liu authored Jan 11, 2024

* [moe] top2 allow uneven input

* [moe] update capacity computing

* [moe] remove debug info

* [moe] update capacity computing

* [moe] update capacity computing

c904d2ae

[moe] init mixtral impl · 7d8e0338
Xuanlei Zhao authored Dec 14, 2023

7d8e0338

06 Feb, 2024 1 commit
- [lr-scheduler] fix load state dict and add test (#5369) · c53ddda8
  Hongxin Liu authored Feb 06, 2024
  
  c53ddda8
04 Feb, 2024 1 commit
- [gemini] fix param op hook when output is tuple (#5355) · 2dd01e3a
  Hongxin Liu authored Feb 04, 2024
```
* [gemini] fix param op hook when output is tuple

* [gemini] fix param op hook
```
  2dd01e3a
02 Feb, 2024 1 commit
- [fix] remove unnecessary dp_size assert (#5351) · 1c790c08
  Wenhao Chen authored Feb 02, 2024
```
* fix: remove unnecessary assert

* test: add more 3d plugin tests

* fix: add warning
```
  1c790c08
01 Feb, 2024 2 commits

[checkpointio] fix gemini and hybrid parallel optim checkpoint (#5347) · ffffc32d

Hongxin Liu authored Feb 01, 2024

* [checkpointio] fix hybrid parallel optim checkpoint

* [extension] fix cuda extension

* [checkpointio] fix gemini optimizer checkpoint

* polish code

ffffc32d

[Chat] fix sft loss nan (#5345) · c5239840
YeAnbang authored Feb 01, 2024
```
* fix script

* fix script

* fix chat nan

* fix chat nan
```
c5239840

31 Jan, 2024 1 commit
- [extension] fixed exception catch (#5342) · abd8e77a
  Frank Lee authored Jan 31, 2024
  
  abd8e77a
30 Jan, 2024 2 commits
- fix typo change dosen't to doesn't (#5308) · 71321a07
  digger yu authored Jan 30, 2024
  
  71321a07
- fix typo under extensions/ (#5330) · 6a3086a5
  digger yu authored Jan 30, 2024
  
  6a3086a5
29 Jan, 2024 6 commits
- [doc] added docs for extensions (#5324) · febed232
  Frank Lee authored Jan 29, 2024
```
* [doc] added docs for extensions

* polish

* polish
```
  febed232
- [tests] fix t5 test. (#5322) · 388179f9
  flybird11111 authored Jan 29, 2024
```
* [ci] fix shardformer tests. (#5255)

* fix ci

fix

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>

* fix t5 test

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  388179f9
- Merge pull request #5321 from FrankLeeeee/hotfix/accelerator-api · a6709afe
  Frank Lee authored Jan 29, 2024
```
[accelerator] fixed npu api
```
  a6709afe
- [accelerator] fixed npu api · 087d0cb1
  FrankLeeeee authored Jan 29, 2024
  
  087d0cb1
- Merge pull request #5310 from hpcaitech/feature/npu · 8823cc48
  Frank Lee authored Jan 29, 2024
```
Feature/npu
```
  8823cc48
- [workflow] updated CI image (#5318) · 73f4dc57
  Frank Lee authored Jan 29, 2024
  
  73f4dc57
25 Jan, 2024 3 commits

[feat] refactored extension module (#5298) · 7cfed5f0

Frank Lee authored Jan 25, 2024

* [feat] refactored extension module

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

7cfed5f0

fix some typo (#5307) · bce9499e
digger yu authored Jan 25, 2024

bce9499e

[NFC] polish... · ec912b1b

李文军 authored Jan 25, 2024

[NFC] polish applications/Colossal-LLaMA-2/colossal_llama2/tokenizer/init_tokenizer.py code style (#5228)

ec912b1b

22 Jan, 2024 2 commits
- fix bug for mefture (#5299) · ddf879e2
  Desperado-Jia authored Jan 22, 2024
  
  ddf879e2
- [hotfix] fix 3d plugin test (#5292) · d7f8db8e
  Hongxin Liu authored Jan 22, 2024
  
  d7f8db8e
19 Jan, 2024 2 commits
- fix llama pretrain (#5287) · f7e3f82a
  flybird11111 authored Jan 19, 2024
  
  f7e3f82a
- [doc] add llama2-13B disyplay (#5285) · 6a569678
  Desperado-Jia authored Jan 19, 2024
```
* Update README.md

* fix 13b typo

---------
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
```
  6a569678
18 Jan, 2024 3 commits
- fix auto loading gpt2 tokenizer (#5279) · 32cb7449
  Michelle authored Jan 18, 2024
  
  32cb7449
- Merge pull request #5278 from ver217/sync/npu · d66e6988
  Frank Lee authored Jan 18, 2024
```
[sync] sync npu branch with main
```
  d66e6988
- Merge branch 'main' into sync/npu · 14846934
  ver217 authored Jan 18, 2024
  
  14846934
17 Jan, 2024 3 commits
- [hotfix] Fix ShardFormer test execution path when using sequence parallelism (#5230) · 5d9a0ae7
  Zhongkai Zhao authored Jan 17, 2024
  
  5d9a0ae7
- [shardformer] hybridparallelplugin support gradients accumulation. (#5246) · 46e09165
  flybird11111 authored Jan 17, 2024
```
* support gradients acc

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

* fix

fix

* fix

fix

fix
```
  46e09165
- [ci] fix test_hybrid_parallel_plugin_checkpoint_io.py (#5276) · 2a0558d8
  flybird11111 authored Jan 17, 2024
```
* fix ci

fix

* fix test

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

* fix

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  2a0558d8
16 Jan, 2024 2 commits
- [workflow] fixed oom tests (#5275) · d69cd2eb
  Frank Lee authored Jan 16, 2024
```
* [workflow] fixed oom tests

* polish

* polish

* polish
```
  d69cd2eb
- [workflow] fixed incomplete bash command (#5272) · 04244aaa
  Frank Lee authored Jan 16, 2024
  
  04244aaa
15 Jan, 2024 1 commit
- [hotfix]: add pp sanity check and fix mbs arg (#5268) · ef4f0ee8
  Wenhao Chen authored Jan 15, 2024
```
* fix: fix misleading mbs arg

* feat: add pp sanity check

* fix: fix 1f1b sanity check
```
  ef4f0ee8
11 Jan, 2024 3 commits
- [doc] fix doc typo (#5256) · c174c4fc
  binmakeswell authored Jan 11, 2024
```
* [doc] fix annotation display

* [doc] fix llama2 doc
```
  c174c4fc
- [ci] fix shardformer tests. (#5255) · e830ef91
  flybird11111 authored Jan 11, 2024
```
* fix ci

fix

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  e830ef91
- fix typo in applications/ColossalEval/README.md (#5250) · 756c400a
  digger yu authored Jan 11, 2024
  
  756c400a