GitLab

merge develop to main

* Added tensor detector

* Added the - states

* Allowed change include_cpu when detect()

[hotfix] fixed error when no collective communication in CommProfiler

[zero] Add bucket tensor shard strategy

fixed typing error

[Bot] Synchronize Submodule References

fix typo in CHANGE_LOG.md

- fix typo, `Unifed` -> `Unified` below Added

fixed broken badge link

* place params on cpu after zero init context

* polish code

* bucketzed cpu gpu tensor transter

* find a bug in sharded optim unittest

* add offload unittest for ShardedOptimV2.

* polish code and make it more robust

* refactored test with component func

* fixed bug

* Added activation offload

* Fixed the import bug, used the pytest