GitLab

* Update GitHub action and pre-commit settings

* Update GitHub action and pre-commit settings (#198)

* add pytorch hooks
fix #175

* remove licenses in src code

* add gpu memory tracer

* replacing print with logger in ophooks.

* added examples as submodule

* update submodule url

* remove examples folder

* added examples as submodule

* update .gitmodules

* remove benchmark folder

* added benchmark submodule

* update .gitmodules

Update the documentations of layer integration

Update _log_hook.py

Update _operation.py

* enable CI after PR sync

* Fixed github action

* add pipeline shared module wrapper and update load batch

* added model parallel process group for amp and clip grad (#86)

* added model parallel process group for amp and clip grad

* update amp and clip with model parallel process group

* remove pipeline_prev/next group (#88)

* micro batch offload

* optimize pipeline gpu memory usage

* pipeline can receive tensor shape (#93)

* optimize pipeline gpu memory usage

* fix grad accumulation step counter

* rename classes and functions
Co-authored-by: Frank Lee <somerlee.9@gmail.com>