GitLab

* [autoparallel] adapt solver with self attention

* polish code

* [cli] updated installation cheheck with more inforamtion

* polish code

* polish code

* [gemini] fix init bugs for modules

* fix bugs

* [setup] supported conda-installed torch

* polish code

* [zero] fix testing parameters

* [gemini] add arguments

* add docstrings

* [Gemini] more tests for Gemini

* polish code

* [testing] fix testing models

* roll back

* [zero] fix memory leak for zero2

* [zero] test gradient accumulation

* [zero] remove grad clip test

* add DAG to split_module

* add comment

* add test case for DAG

* remove print

* add DAG middleware in scheduler

* add test case for scheduler

* remove break

* recover old lifecycle
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [autoparallel] add split handler

* add numerical test and runtime passes

* add DAG to split_module

* add comment

* add test case for DAG

* remove print
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* Update bug-report.yml

* Update documentation.yml

* Update bug-report.yml

* Update feature_request.yml

* Update proposal.yml

* [autoparallel] add experimental view handler

* polish

* polish

* polish code

* rename variables

* Add mix-gather

* Add comments

* Add comments

* Polish comments

* Change the global rank assumption

* Add tests

* Add two-step tests

* Fix 10 and 01

* Skip test becasue the number of GPUs