GitLab

* [workflow] fixed oom tests

* polish

* polish

* polish

* [workflow] fixed build CI

* polish

* polish

* polish

* polish

* polish

* [lazy] patch from pretrained

* [lazy] fix from pretrained and add tests

* [devops] update ci

* [lazy] support _like methods and clamp

* [lazy] pass transformers models

* [lazy] fix device move and requires grad

* [lazy] fix requires grad and refactor api

* [lazy] fix requires grad

* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format

* [hotfix] fix gemini and zero test

* [hotfix] fix lazy init test

* [hotfix] fix lazy init test

* [test] remove legacy zero test

* [test] remove lazy distribute test

* [test] remove outdated checkpoint io

* [lazy] support init on cuda

* [test] update lazy init test

* [test] fix transformer version

* [test] fixed tests failed due to dtensor change

* polish code

* [shardformer] support module saving and loading

* polish code

* [shardformer] adapted T5 and LLaMa test to use kit

* polish code

* [lazy] remove old lazy init

* [lazy] refactor lazy init folder structure

* [lazy] fix lazy tensor deepcopy

* [test] update lazy init test