GitLab

* [example] updated the hybrid parallel tutorial

* polish code

* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost

* [example] improved the clarity yof the example readme

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* change the benchmark config file

* change config

* revert config file

* rename distpan to distplan

* [workflow] refactored the example check workflow

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* [hotfix] fix gpt gemini example

* [example] add new assertions

* [workflows]bug_repair

* [workflow]new_pr_fixing_bugs
Co-authored-by: binmakeswell <binmakeswell@gmail.com>

accelerator.num_processes -> gpc.get_world_size(ParallelMode.DATA)

* [doc] update link

* add benchmark

* merge common func

* add total and avg tflops
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [autoparallel] gpt2 autoparallel examples

* polish code

* polish code

* [doc] updated the stable diffussion on docker usage

* polish doc

* [builder] builder for scaled_upper_triang_masked_softmax

* add missing files

* fix a bug

* polish code

* [example] diffusion install from docker