Commits · 7d8e0338a40da196436bef866ebdc43d5ed1c677 · OpenDAS / ColossalAI

07 Feb, 2024 1 commit
- [moe] init mixtral impl · 7d8e0338
  Xuanlei Zhao authored Dec 14, 2023
  
  7d8e0338
06 Feb, 2024 1 commit
- [lr-scheduler] fix load state dict and add test (#5369) · c53ddda8
  Hongxin Liu authored Feb 06, 2024
  
  c53ddda8
04 Feb, 2024 1 commit
- [gemini] fix param op hook when output is tuple (#5355) · 2dd01e3a
  Hongxin Liu authored Feb 04, 2024
```
* [gemini] fix param op hook when output is tuple

* [gemini] fix param op hook
```
  2dd01e3a
02 Feb, 2024 1 commit
- [fix] remove unnecessary dp_size assert (#5351) · 1c790c08
  Wenhao Chen authored Feb 02, 2024
```
* fix: remove unnecessary assert

* test: add more 3d plugin tests

* fix: add warning
```
  1c790c08
01 Feb, 2024 2 commits

[checkpointio] fix gemini and hybrid parallel optim checkpoint (#5347) · ffffc32d

Hongxin Liu authored Feb 01, 2024

* [checkpointio] fix hybrid parallel optim checkpoint

* [extension] fix cuda extension

* [checkpointio] fix gemini optimizer checkpoint

* polish code

ffffc32d

[Chat] fix sft loss nan (#5345) · c5239840
YeAnbang authored Feb 01, 2024
```
* fix script

* fix script

* fix chat nan

* fix chat nan
```
c5239840

31 Jan, 2024 1 commit
- [extension] fixed exception catch (#5342) · abd8e77a
  Frank Lee authored Jan 31, 2024
  
  abd8e77a
30 Jan, 2024 2 commits
- fix typo change dosen't to doesn't (#5308) · 71321a07
  digger yu authored Jan 30, 2024
  
  71321a07
- fix typo under extensions/ (#5330) · 6a3086a5
  digger yu authored Jan 30, 2024
  
  6a3086a5
29 Jan, 2024 6 commits
- [doc] added docs for extensions (#5324) · febed232
  Frank Lee authored Jan 29, 2024
```
* [doc] added docs for extensions

* polish

* polish
```
  febed232
- [tests] fix t5 test. (#5322) · 388179f9
  flybird11111 authored Jan 29, 2024
```
* [ci] fix shardformer tests. (#5255)

* fix ci

fix

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>

* fix t5 test

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  388179f9
- Merge pull request #5321 from FrankLeeeee/hotfix/accelerator-api · a6709afe
  Frank Lee authored Jan 29, 2024
```
[accelerator] fixed npu api
```
  a6709afe
- [accelerator] fixed npu api · 087d0cb1
  FrankLeeeee authored Jan 29, 2024
  
  087d0cb1
- Merge pull request #5310 from hpcaitech/feature/npu · 8823cc48
  Frank Lee authored Jan 29, 2024
```
Feature/npu
```
  8823cc48
- [workflow] updated CI image (#5318) · 73f4dc57
  Frank Lee authored Jan 29, 2024
  
  73f4dc57
25 Jan, 2024 3 commits

[feat] refactored extension module (#5298) · 7cfed5f0

Frank Lee authored Jan 25, 2024

* [feat] refactored extension module

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

7cfed5f0

fix some typo (#5307) · bce9499e
digger yu authored Jan 25, 2024

bce9499e

[NFC] polish... · ec912b1b

李文军 authored Jan 25, 2024

[NFC] polish applications/Colossal-LLaMA-2/colossal_llama2/tokenizer/init_tokenizer.py code style (#5228)

ec912b1b

22 Jan, 2024 2 commits
- fix bug for mefture (#5299) · ddf879e2
  Desperado-Jia authored Jan 22, 2024
  
  ddf879e2
- [hotfix] fix 3d plugin test (#5292) · d7f8db8e
  Hongxin Liu authored Jan 22, 2024
  
  d7f8db8e
19 Jan, 2024 2 commits
- fix llama pretrain (#5287) · f7e3f82a
  flybird11111 authored Jan 19, 2024
  
  f7e3f82a
- [doc] add llama2-13B disyplay (#5285) · 6a569678
  Desperado-Jia authored Jan 19, 2024
```
* Update README.md

* fix 13b typo

---------
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
```
  6a569678
18 Jan, 2024 3 commits
- fix auto loading gpt2 tokenizer (#5279) · 32cb7449
  Michelle authored Jan 18, 2024
  
  32cb7449
- Merge pull request #5278 from ver217/sync/npu · d66e6988
  Frank Lee authored Jan 18, 2024
```
[sync] sync npu branch with main
```
  d66e6988
- Merge branch 'main' into sync/npu · 14846934
  ver217 authored Jan 18, 2024
  
  14846934
17 Jan, 2024 3 commits
- [hotfix] Fix ShardFormer test execution path when using sequence parallelism (#5230) · 5d9a0ae7
  Zhongkai Zhao authored Jan 17, 2024
  
  5d9a0ae7
- [shardformer] hybridparallelplugin support gradients accumulation. (#5246) · 46e09165
  flybird11111 authored Jan 17, 2024
```
* support gradients acc

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

* fix

fix

* fix

fix

fix
```
  46e09165
- [ci] fix test_hybrid_parallel_plugin_checkpoint_io.py (#5276) · 2a0558d8
  flybird11111 authored Jan 17, 2024
```
* fix ci

fix

* fix test

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

* fix

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  2a0558d8
16 Jan, 2024 2 commits
- [workflow] fixed oom tests (#5275) · d69cd2eb
  Frank Lee authored Jan 16, 2024
```
* [workflow] fixed oom tests

* polish

* polish

* polish
```
  d69cd2eb
- [workflow] fixed incomplete bash command (#5272) · 04244aaa
  Frank Lee authored Jan 16, 2024
  
  04244aaa
15 Jan, 2024 1 commit
- [hotfix]: add pp sanity check and fix mbs arg (#5268) · ef4f0ee8
  Wenhao Chen authored Jan 15, 2024
```
* fix: fix misleading mbs arg

* feat: add pp sanity check

* fix: fix 1f1b sanity check
```
  ef4f0ee8
11 Jan, 2024 5 commits
- [doc] fix doc typo (#5256) · c174c4fc
  binmakeswell authored Jan 11, 2024
```
* [doc] fix annotation display

* [doc] fix llama2 doc
```
  c174c4fc
- [ci] fix shardformer tests. (#5255) · e830ef91
  flybird11111 authored Jan 11, 2024
```
* fix ci

fix

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  e830ef91
- fix typo in applications/ColossalEval/README.md (#5250) · 756c400a
  digger yu authored Jan 11, 2024
  
  756c400a
- [ci] fixed ddp test (#5254) · 2b834187
  Frank Lee authored Jan 11, 2024
```
* [ci] fixed ddp test

* polish
```
  2b834187
- [ci] fixed booster test (#5251) · d5eeeb14
  Frank Lee authored Jan 11, 2024
```
* [ci] fixed booster test

* [ci] fixed booster test

* [ci] fixed booster test
```
  d5eeeb14
10 Jan, 2024 2 commits
- [workflow] fixed build CI (#5240) · edf94a35
  Frank Lee authored Jan 10, 2024
```
* [workflow] fixed build CI

* polish

* polish

* polish

* polish

* polish
```
  edf94a35
- [doc] fix typo in Colossal-LLaMA-2/README.md (#5247) · 41e52c1c
  digger yu authored Jan 10, 2024
  
  41e52c1c
09 Jan, 2024 2 commits

[hotfix] removed unused flag (#5242) · 9102d655
Frank Lee authored Jan 09, 2024

9102d655

[npu] change device to accelerator api (#5239) · d202cc28

Hongxin Liu authored Jan 09, 2024



* update accelerator

* fix timer

* fix amp

* update

* fix

* update bug

* add error raise

* fix autocast

* fix set device

* remove doc accelerator

* update doc

* update doc

* update doc

* use nullcontext

* update cpu

* update null context

* change time limit for example

* udpate

* update

* update

* update

* [npu] polish accelerator code

---------
Co-authored-by: Xuanlei Zhao <xuanlei.zhao@gmail.com>
Co-authored-by: zxl <43881818+oahzxl@users.noreply.github.com>

d202cc28