- 08 Feb, 2024 4 commits
-
-
Hongxin Liu authored
-
Frank Lee authored
-
Frank Lee authored
[llama] support npu for Colossal-LLaMA-2
-
ver217 authored
-
- 07 Feb, 2024 6 commits
-
-
Hongxin Liu authored
-
Hongxin Liu authored
-
Hongxin Liu authored
-
Hongxin Liu authored
* [moe] add mixtral block for single expert * [moe] mixtral block fwd support uneven ep * [moe] mixtral block bwd support uneven ep * [moe] add mixtral moe layer * [moe] simplify replace * [meo] support save sharded mixtral * [meo] support load sharded mixtral * [meo] support save sharded optim * [meo] integrate moe manager into plug * [meo] fix optimizer load * [meo] fix mixtral layer
-
Hongxin Liu authored
* [moe] top2 allow uneven input * [moe] update capacity computing * [moe] remove debug info * [moe] update capacity computing * [moe] update capacity computing
-
Xuanlei Zhao authored
-
- 06 Feb, 2024 4 commits
-
-
Hongxin Liu authored
* [llama] fix memory issue * [llama] add comment
-
Hongxin Liu authored
-
Hongxin Liu authored
-
Camille Zhong authored
-
- 05 Feb, 2024 4 commits
-
-
Camille Zhong authored
-
Hongxin Liu authored
-
Hongxin Liu authored
* [llama] update training script * [doc] polish docstr
-
Hongxin Liu authored
* [plugin] refactor prepare dataloader * [plugin] update train script
-
- 04 Feb, 2024 1 commit
-
-
Hongxin Liu authored
* [gemini] fix param op hook when output is tuple * [gemini] fix param op hook
-
- 02 Feb, 2024 1 commit
-
-
Wenhao Chen authored
* fix: remove unnecessary assert * test: add more 3d plugin tests * fix: add warning
-
- 01 Feb, 2024 2 commits
-
-
Hongxin Liu authored
* [checkpointio] fix hybrid parallel optim checkpoint * [extension] fix cuda extension * [checkpointio] fix gemini optimizer checkpoint * polish code
-
YeAnbang authored
* fix script * fix script * fix chat nan * fix chat nan
-
- 31 Jan, 2024 1 commit
-
-
Frank Lee authored
-
- 30 Jan, 2024 2 commits
- 29 Jan, 2024 6 commits
-
-
Frank Lee authored
* [doc] added docs for extensions * polish * polish
-
flybird11111 authored
* [ci] fix shardformer tests. (#5255) * fix ci fix * revert: revert p2p * feat: add enable_metadata_cache option * revert: enable t5 tests --------- Co-authored-by:
Wenhao Chen <cwher@outlook.com> * fix t5 test --------- Co-authored-by:
Wenhao Chen <cwher@outlook.com>
-
Frank Lee authored
[accelerator] fixed npu api
-
FrankLeeeee authored
-
Frank Lee authored
Feature/npu
-
Frank Lee authored
-
- 25 Jan, 2024 3 commits
- 22 Jan, 2024 2 commits
-
-
Desperado-Jia authored
-
Hongxin Liu authored
-
- 19 Jan, 2024 2 commits
-
-
flybird11111 authored
-
Desperado-Jia authored
* Update README.md * fix 13b typo --------- Co-authored-by:binmakeswell <binmakeswell@gmail.com>
-
- 18 Jan, 2024 2 commits