GitLab

* [example] updated large-batch optimizer tutorial

* polish code

* polish code

* [example] updated the hybrid parallel tutorial

* polish code

* [ddp] add is_ddp_ignored

[ddp] rename to is_ddp_ignored

* [zero] fix state_dict and load_state_dict

* fix bugs

* [zero] update unit test for ZeroDDP

* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost

[ddp] rename to is_ddp_ignored

* [example] improved the clarity yof the example readme

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* [doc] added documentation for CI/CD

* polish markdown

* polish markdown

* polish markdown

* [workflow]auto comment with test coverage report

* polish code

* polish yaml

* [workflow] added precommit check for code consistency

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* change the benchmark config file

* change config

* revert config file

* rename distpan to distplan

* [workflow] refactored the example check workflow

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* [worfklow] added coverage test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code