GitLab

* [autoparallel] fixed wrong sharding strategy in conv handler

* polish code

* [autoparallel] fixed wrong generated strategy for dot op

* polish code

* [autoparallel] handled illegal sharding strategy in shape consistency

* polish code

* [autoparallel] handled illegal strategy in node handler

* polish code

* [fx/profiler] add test.

* [fx] fix file names.

* [fx] add docstring and comment.

* [fx] polish profiler.py.

* [fx] fix import errors.

* [fx] fix profiler.

* [fx] fix names.

* [autoparallel] handled illegal sharding strategy

* polish code

Co-authored-by: ric <mkkt_bkkt@mail.ustc.edu.cn>

* add chunk manager init function

* fix unit tests

* add comment

* add flush=True

* update pre-commit

* update pre-commit

[fx/meta/rpc] move _meta_registration.py to fx folder / register fx functions with compatibility checks / remove color debug (#1710)

* [fx] move meta registration

* [fx] fix tests.

* [fx] fix test.

* [fx] fix.

* [meta] refactor meta registration.py.

* [fx] add compatibility descriptions.

* [fx] polish import.

* [fx] add a decorator.

* [fx] fix tests.

* [fx] remove print.

* [fx] edit raise error.

* [fx] edit raise error.

* [fx] add type hint.

* [fx] fix import in experimental.

* [rpc] remove color debug.

* [meta] fix naming.

* [autoparallel] resnet block runtime apply

* seperate buffer and parameter in MemoryCost

* polish code

* add comments and todos

* fix test issue

* fixes memory leak when paramter is in fp16 in ZeroDDP init.
* bans chunk releasement in CUDA. Only when a chunk is about to offload, it is allowed to release.
* adds a constant placement policy. With it, users can allocate a reserved caching memory space for parameters.

* [autoparallel] refactored the autoparallel module for organization

* polish code

* [autoparallel] adapt runtime passes v2

* polish code