GitLab

Co-authored-by: Boxiang Wang <boxiang.wang1@gmail.com>

Co-authored-by: github-actions <github-actions@github.com>

* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test

Merge for SC tutorial

* [fx] metainfo_trace as an API.

* [fx] add return.

* remove redundant config

* remove redundant dependency

Co-authored-by: superhao1995 <804673818@qq.com>

Co-authored-by: RichardoLuo <14049555596@qq.com>

[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py code style (#1845)

[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py code style (#1829)
Co-authored-by: siqi <siqi@siqis-MacBook-Pro.local>

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [NFC] polish colossalai/nn/metric/accuracy_2p5d.py code style (#1714)

* [NFC] polish colossalai/zero/sharded_param/__init__.py code style

* [NFC] polish colossalai/amp/naive_amp/_utils.py code style
Co-authored-by: shenggan <csg19971016@gmail.com>
Co-authored-by: ric <mkkt_bkkt@mail.ustc.edu.cn>