GitLab

Co-authored-by: github-actions <github-actions@github.com>

* [autoparallel] process size nodes in runtime pass

* polish code

[example] support stable diffusion v2

Co-authored-by: github-actions <github-actions@github.com>

* [optimizer] add div_scale for optimizers

* [zero] use div_scale in zero optimizer

* fix testing error

* add bwd and step for PP middleware

* pre-commit
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [zero] add L2 gradient clipping

* [testing] add MlpModel

* [zero] add unit test for grad clipping

* fix atol

* add DAG test case

* fix datarace by adjusting theposition of lock

* polish code

* fix pytest for middleware

* remove test
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [autoparallel] add bias addtion function class

* polish code

* polish

* [fx] add a symbolic_trace api.

* [fx] fix import errors.

* [fx] ColoTracer experimental.

* [autoparallel] add embedding handler

* fix bugs