GitLab

* add benchmark

* merge common func

* add total and avg tflops
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [autoparallel] gpt2 autoparallel examples

* polish code

* polish code

* move to cpu to avoid dead lock

* get output by offsets
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [autoparallel] patch torch.flatten

* [doc] updated the stable diffussion on docker usage

* polish doc

* [builder] builder for scaled_upper_triang_masked_softmax

* add missing files

* fix a bug

* polish code

* [example] diffusion install from docker

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [builder] polish builder

* remove print

* [autoparallel] record parameter attribute in collotracer

* [autoparallel] fix construct_meta_info bug