- 29 Jun, 2022 2 commits
-
-
ver217 authored
* add reducer * update colo ddp with reducer * polish unit test * polish unit test
-
Jiarui Fang authored
-
- 27 Jun, 2022 3 commits
-
-
Jiarui Fang authored
-
Jiarui Fang authored
-
Jiarui Fang authored
-
- 24 Jun, 2022 3 commits
-
-
ver217 authored
* sharded optim supports loading local state dict * polish code * add unit test
-
ver217 authored
* zero optim supports loading local state dict * polish code * add unit test
-
Jiarui Fang authored
-
- 23 Jun, 2022 2 commits
-
-
Jiarui Fang authored
-
Jiarui Fang authored
-
- 22 Jun, 2022 5 commits
-
-
Jiarui Fang authored
-
ver217 authored
-
ver217 authored
* add more element-wise ops * update test_op * polish unit test
-
ver217 authored
* dist spec s2s uses all-to-all * update unit test * add sanity check * polish unitest test with titans * add sanity check for DistMgr * add sanity check Co-authored-by:jiaruifang <fangjiarui123@gmail.com>
-
Jiarui Fang authored
-
- 21 Jun, 2022 2 commits
-
-
Jiarui Fang authored
-
ver217 authored
* ColoDDP supports overwriting default process group * rename ColoDDPV2 to ZeroDDP * add docstr for ZeroDDP * polish docstr
-
- 20 Jun, 2022 1 commit
-
-
ver217 authored
* add save/load state dict for ColoDDP * add unit test * refactor unit test folder * polish unit test * rename unit test
-
- 17 Jun, 2022 1 commit
-
-
ver217 authored
* fix param op hook * update zero tp test * fix bugs
-
- 16 Jun, 2022 1 commit
-
-
ver217 authored
* add set_params_to_ignore for ColoDDP * polish code * fix zero hook v2 * add unit test * polish docstr
-
- 15 Jun, 2022 3 commits
-
-
YuliangLiu0306 authored
* [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c. * feature/add autoparallel passes
-
Frank Lee authored
* [fx] added unit test for coloproxy * polish code * polish code
-
ver217 authored
* update gemini mgr * update chunk * add docstr * polish placement policy * update test chunk * update test zero * polish unit test * remove useless unit test
-
- 14 Jun, 2022 1 commit
-
-
Frank Lee authored
-
- 10 Jun, 2022 3 commits
-
-
ver217 authored
* add placement policy * add gemini mgr * update mem stats collector * update zero * update zero optim * fix bugs * zero optim monitor os * polish unit test * polish unit test * add assert
-
Frank Lee authored
* [pipeline] refactor the pipeline module * polish code
-
Frank Lee authored
* [context] support lazy init of module * polish code
-
- 09 Jun, 2022 3 commits
-
-
ver217 authored
* polish chunk manager * polish unit test * impl add_extern_static_tensor for chunk mgr * add mem stats collector v2 * polish code * polish unit test * polish code * polish get chunks
-
Ziyue Jiang authored
* fix equal assert * polish
-
Frank Lee authored
* [test] skip tests when not enough GPUs are detected * polish code * polish code
-
- 08 Jun, 2022 2 commits
-
-
Frank Lee authored
* [test] ignore 8 gpu test * polish code * polish workflow * polish workflow
-
Ziyue Jiang authored
* Add CPU 1d row embedding * polish
-
- 07 Jun, 2022 1 commit
-
-
ver217 authored
-
- 06 Jun, 2022 2 commits
-
-
Ziyue Jiang authored
-
Jiarui Fang authored
-
- 03 Jun, 2022 2 commits
-
-
Jiarui Fang authored
* reorgnize colotensor directory * polish code
-
Ziyue Jiang authored
-
- 02 Jun, 2022 2 commits
-
-
YuliangLiu0306 authored
* [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c. * refactor ppschedule to support tensor list * polish
-
ver217 authored
* add zero optimizer * torch ok * unit test ok * polish code * fix bugs * polish unit test * polish zero optim * polish colo ddp v2 * refactor folder structure * add comment * polish unit test * polish zero optim * polish unit test
-
- 31 May, 2022 1 commit
-
-
ver217 authored
-