GitLab

* [fx] add a symbolic_trace api.

* [fx] fix import errors.

* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [NFC] polish type hint for shape consistency

* polish code

* polish code

* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [autoparallel] refactor and add rotorc.

* [autoparallel] refactor and add rotorc.

Co-authored-by: github-actions <github-actions@github.com>

* [autoparallel] add getattr haandler

* polish code

* add extra processes for Parameters

* add unit test for param resharding cost

* add docstring and polish test

* [hotfix] fix zero's incompatibility with checkpoint in torch-1.12

* [zero] add cpu shard init

* [zero] add tiny example test

* [colo_tensor] fix bugs for torch-1.11

* [autoparallel] refactor tracer to fix bias addition issue

* [fx] support module with bias addition

* create bias_addition_module

* refactor file structure

* polish code

* fix unit test

* [autoparallel] added matmul handler

* polish code

* [autoparallel] first move.

* [autoparallel] add solver rotor.

* [autoparallel] add ckpt solvers.

* [autoparallel] modify codegen.

* [fx] fix annotation in test.

* [fx] remove check.

* [autoparallel] polish docstring.

* [fx] refactor MetaTensor.

Co-authored-by: github-actions <github-actions@github.com>

* [autoparallel] update CommSpec to CommActions

* polish code

* [autoparallel] add numerical test for node strategies

* polish code

* polish code

* [fx] change memory.py to memory_utils.py.

* [fx] add shard utils.

* [fx] fix import.

* [fx] check code style.

* [fx] add comment.

* [autoparallel] first move.

* [fx] add time computations.

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [autoparallel] refactor the runtime apply pass and add doc string to passes

* fix unit test

* polish

* [autoparallel] added binary elementwise node handler

* polish code