Commits · a5756a8720439ffc5b70954c9d5e9c9f021461ee · OpenDAS / ColossalAI

".github/workflows/auto_compatibility_test.yml" did not exist on "65ad47c35c9166c2493d658fbcdaba8d93268ca1"

06 Feb, 2024 1 commit
- [eval] update llama npu eval (#5366) · a5756a87
  Camille Zhong authored Feb 06, 2024
  
  a5756a87
05 Feb, 2024 4 commits
- [llama] fix neftune & pbar with start_step (#5364) · 44ca61a2
  Camille Zhong authored Feb 05, 2024
  
  44ca61a2
- [llama] add flash attn patch for npu (#5362) · a4cec171
  Hongxin Liu authored Feb 05, 2024
  
  a4cec171
- [llama] update training script (#5360) · 73f9f23f
  Hongxin Liu authored Feb 05, 2024
```
* [llama] update training script

* [doc] polish docstr
```
  73f9f23f
- [llama] fix dataloader for hybrid parallel (#5358) · 6c0fa7b9
  Hongxin Liu authored Feb 05, 2024
```
* [plugin] refactor prepare dataloader

* [plugin] update train script
```
  6c0fa7b9
04 Feb, 2024 1 commit
- [gemini] fix param op hook when output is tuple (#5355) · 2dd01e3a
  Hongxin Liu authored Feb 04, 2024
```
* [gemini] fix param op hook when output is tuple

* [gemini] fix param op hook
```
  2dd01e3a
02 Feb, 2024 1 commit
- [fix] remove unnecessary dp_size assert (#5351) · 1c790c08
  Wenhao Chen authored Feb 02, 2024
```
* fix: remove unnecessary assert

* test: add more 3d plugin tests

* fix: add warning
```
  1c790c08
01 Feb, 2024 2 commits

[checkpointio] fix gemini and hybrid parallel optim checkpoint (#5347) · ffffc32d

Hongxin Liu authored Feb 01, 2024

* [checkpointio] fix hybrid parallel optim checkpoint

* [extension] fix cuda extension

* [checkpointio] fix gemini optimizer checkpoint

* polish code

ffffc32d

[Chat] fix sft loss nan (#5345) · c5239840
YeAnbang authored Feb 01, 2024
```
* fix script

* fix script

* fix chat nan

* fix chat nan
```
c5239840

31 Jan, 2024 1 commit
- [extension] fixed exception catch (#5342) · abd8e77a
  Frank Lee authored Jan 31, 2024
  
  abd8e77a
30 Jan, 2024 2 commits
- fix typo change dosen't to doesn't (#5308) · 71321a07
  digger yu authored Jan 30, 2024
  
  71321a07
- fix typo under extensions/ (#5330) · 6a3086a5
  digger yu authored Jan 30, 2024
  
  6a3086a5
29 Jan, 2024 6 commits
- [doc] added docs for extensions (#5324) · febed232
  Frank Lee authored Jan 29, 2024
```
* [doc] added docs for extensions

* polish

* polish
```
  febed232
- [tests] fix t5 test. (#5322) · 388179f9
  flybird11111 authored Jan 29, 2024
```
* [ci] fix shardformer tests. (#5255)

* fix ci

fix

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>

* fix t5 test

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  388179f9
- Merge pull request #5321 from FrankLeeeee/hotfix/accelerator-api · a6709afe
  Frank Lee authored Jan 29, 2024
```
[accelerator] fixed npu api
```
  a6709afe
- [accelerator] fixed npu api · 087d0cb1
  FrankLeeeee authored Jan 29, 2024
  
  087d0cb1
- Merge pull request #5310 from hpcaitech/feature/npu · 8823cc48
  Frank Lee authored Jan 29, 2024
```
Feature/npu
```
  8823cc48
- [workflow] updated CI image (#5318) · 73f4dc57
  Frank Lee authored Jan 29, 2024
  
  73f4dc57
25 Jan, 2024 3 commits

[feat] refactored extension module (#5298) · 7cfed5f0

Frank Lee authored Jan 25, 2024

* [feat] refactored extension module

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

7cfed5f0

fix some typo (#5307) · bce9499e
digger yu authored Jan 25, 2024

bce9499e

[NFC] polish... · ec912b1b

李文军 authored Jan 25, 2024

[NFC] polish applications/Colossal-LLaMA-2/colossal_llama2/tokenizer/init_tokenizer.py code style (#5228)

ec912b1b

22 Jan, 2024 2 commits
- fix bug for mefture (#5299) · ddf879e2
  Desperado-Jia authored Jan 22, 2024
  
  ddf879e2
- [hotfix] fix 3d plugin test (#5292) · d7f8db8e
  Hongxin Liu authored Jan 22, 2024
  
  d7f8db8e
19 Jan, 2024 2 commits
- fix llama pretrain (#5287) · f7e3f82a
  flybird11111 authored Jan 19, 2024
  
  f7e3f82a
- [doc] add llama2-13B disyplay (#5285) · 6a569678
  Desperado-Jia authored Jan 19, 2024
```
* Update README.md

* fix 13b typo

---------
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
```
  6a569678
18 Jan, 2024 3 commits
- fix auto loading gpt2 tokenizer (#5279) · 32cb7449
  Michelle authored Jan 18, 2024
  
  32cb7449
- Merge pull request #5278 from ver217/sync/npu · d66e6988
  Frank Lee authored Jan 18, 2024
```
[sync] sync npu branch with main
```
  d66e6988
- Merge branch 'main' into sync/npu · 14846934
  ver217 authored Jan 18, 2024
  
  14846934
17 Jan, 2024 3 commits
- [hotfix] Fix ShardFormer test execution path when using sequence parallelism (#5230) · 5d9a0ae7
  Zhongkai Zhao authored Jan 17, 2024
  
  5d9a0ae7
- [shardformer] hybridparallelplugin support gradients accumulation. (#5246) · 46e09165
  flybird11111 authored Jan 17, 2024
```
* support gradients acc

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

* fix

fix

* fix

fix

fix
```
  46e09165
- [ci] fix test_hybrid_parallel_plugin_checkpoint_io.py (#5276) · 2a0558d8
  flybird11111 authored Jan 17, 2024
```
* fix ci

fix

* fix test

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

* fix

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  2a0558d8
16 Jan, 2024 2 commits
- [workflow] fixed oom tests (#5275) · d69cd2eb
  Frank Lee authored Jan 16, 2024
```
* [workflow] fixed oom tests

* polish

* polish

* polish
```
  d69cd2eb
- [workflow] fixed incomplete bash command (#5272) · 04244aaa
  Frank Lee authored Jan 16, 2024
  
  04244aaa
15 Jan, 2024 1 commit
- [hotfix]: add pp sanity check and fix mbs arg (#5268) · ef4f0ee8
  Wenhao Chen authored Jan 15, 2024
```
* fix: fix misleading mbs arg

* feat: add pp sanity check

* fix: fix 1f1b sanity check
```
  ef4f0ee8
11 Jan, 2024 5 commits
- [doc] fix doc typo (#5256) · c174c4fc
  binmakeswell authored Jan 11, 2024
```
* [doc] fix annotation display

* [doc] fix llama2 doc
```
  c174c4fc
- [ci] fix shardformer tests. (#5255) · e830ef91
  flybird11111 authored Jan 11, 2024
```
* fix ci

fix

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

---------
Co-authored-by: Wenhao Chen <cwher@outlook.com>
```
  e830ef91
- fix typo in applications/ColossalEval/README.md (#5250) · 756c400a
  digger yu authored Jan 11, 2024
  
  756c400a
- [ci] fixed ddp test (#5254) · 2b834187
  Frank Lee authored Jan 11, 2024
```
* [ci] fixed ddp test

* polish
```
  2b834187
- [ci] fixed booster test (#5251) · d5eeeb14
  Frank Lee authored Jan 11, 2024
```
* [ci] fixed booster test

* [ci] fixed booster test

* [ci] fixed booster test
```
  d5eeeb14
10 Jan, 2024 1 commit
- [workflow] fixed build CI (#5240) · edf94a35
  Frank Lee authored Jan 10, 2024
```
* [workflow] fixed build CI

* polish

* polish

* polish

* polish

* polish
```
  edf94a35