GitLab

* [fx] add nested activation_checkpoint codegen

* undo algorithms commits

* solver

* undo some commits

* [fx] torch11 add nested activation checkpoint codegen

* remove some imports

* [fx] add some comments in activation codegen

* [fx] codegen instance error fix

Co-authored-by: ric <mkkt_bkkt@mail.ustc.edu.cn>

Co-authored-by: Research <research@soccf-snr3-017.comp.nus.edu.sg>

Co-authored-by: JThh <jiatong.han@u.nus.edu>

Co-authored-by: henryqin1997 <henryqin1997@gamil.com>

* [fx] compute memory stat and flop count for MetaInfoProp.

* [fx] modify node attribute.

* [fx] modify ckpt_chen.

* [fx] fix compatibility.

* [fx] fix import error.

* [fx] skip test for MetaInfoProp.

* [fx] skip test for MetaInfoProp.

* [fx] skip test for MetaInfoProp.

* [fx] skip test for MetaInfoProp.

* [fx] skip if torch 1.11.0.

* [fx] recover MetaInfoProp support for PyTorch 1.11.

* [fx] provide a stable but not accurate enough version of profiler.

* [fx] provide a stable but not accurate enough version of profiler.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix compatibility in tests.

* [fx] fix import error.

Co-authored-by: github-actions <github-actions@github.com>

* refactor parallel layer

* broadcast rank0 model after load ckpt

* fix init context

* fix lazy init ctx

* [fx] Add common node into linearize

* [fx] Add common node to solver