GitLab

* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests

* [utils] integrated colotensor with lazy init context

* polish code

* polish code

* polish code

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx] add balanced policy v2

* add unittest

* add test and fix bugs

* add functions back

* add comments

* [fx] added apex normalization to patched modules

* remove unused imports

* make it faster

* [hotfix] remove circle import

* make it faster

* [hotfix] torchvison fx tests

* [hotfix] rename duplicated named test_gpt.py

* [fx] fixed tracing with apex-based T5 model

* polish code

* polish code

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* manipulation

* [fx]add graph manipulation methods.

* [fx]methods to get fx graph property.

* add unit test

* add docstring to explain top node and leaf node in this context

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c.

* [fx]add split module pass and unit test from pipeline passes

* fix MNASNet bug

* polish

* make it faster

* [tensor] rename convert_to_dist -> redistribute

* [tensor] ShardSpec and ReplicaSpec

* [tensor] redistribute among diff pgs

* polish code