GitLab

[zero] Add bucket tensor shard strategy

fixed typing error

[Bot] Synchronize Submodule References

fix typo in CHANGE_LOG.md

- fix typo, `Unifed` -> `Unified` below Added

fixed broken badge link

* place params on cpu after zero init context

* polish code

* bucketzed cpu gpu tensor transter

* find a bug in sharded optim unittest

* add offload unittest for ShardedOptimV2.

* polish code and make it more robust

* refactored test with component func

* fixed bug

* Added activation offload

* Fixed the import bug, used the pytest

This reverts commit bef05489b642385c80e59fe757d598efd1752ecf.

Fuzhao updated

Co-authored-by: huangziyu <202476410arsmart@gmail.com>