GitLab

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [example] update vit ci script

* [example] update requirements

* [example] update requirements

* [example] integrate autoparallel demo with CI

* polish code

* polish code

* polish code

* polish code

* [examples] update autoparallel tutorial demo

* add test_ci.sh

* polish

* add conda yaml

* Update initialize.py

* pre-commit run check

* [workflow] automated bdist wheel build

* polish workflow

* polish readme

* polish readme

* [autoparallel] update binary elementwise handler

* polish

* [workflow] automated the compatiblity test

* polish code

* [example] updated large-batch optimizer tutorial

* polish code

* polish code

* [example] updated the hybrid parallel tutorial

* polish code

* [ddp] add is_ddp_ignored

[ddp] rename to is_ddp_ignored

* [zero] fix state_dict and load_state_dict

* fix bugs

* [zero] update unit test for ZeroDDP

* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost

[ddp] rename to is_ddp_ignored

* [example] improved the clarity yof the example readme

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* [doc] added documentation for CI/CD

* polish markdown

* polish markdown

* polish markdown

* [workflow]auto comment with test coverage report

* polish code

* polish yaml