GitLab

* [lazy] support init on cuda

* [test] update lazy init test

* [test] fix transformer version

* [test] fixed tests failed due to dtensor change

* polish code

* [shardformer] support module saving and loading

* polish code

* [shardformer] adapted T5 and LLaMa test to use kit

* polish code

* [lazy] remove old lazy init

* [lazy] refactor lazy init folder structure

* [lazy] fix lazy tensor deepcopy

* [test] update lazy init test