GitLab

* [lazy] patch from pretrained

* [lazy] fix from pretrained and add tests

* [devops] update ci

* [test] fix flop tensor test

* [test] fix autochunk test

* [test] fix lazyinit test

* [devops] update torch version of CI

* [devops] enable testmon

* [devops] fix ci

* [devops] fix ci

* [test] fix checkpoint io test

* [test] fix cluster test

* [test] fix timm test

* [devops] fix ci

* [devops] fix ci

* [devops] fix ci

* [devops] fix ci

* [devops] force sync to test ci

* [test] skip fsdp test

* [workflow] added notification if scheduled build fails

* polish code

* polish code

* [workflow] adjust the GPU memory threshold for scheduled unit test

* polish code

* [setup] make cuda extension build optional

* polish code

* polish code

* polish code

* impl nvme optimizer

* update cpu adam

* add unit test

* update hybrid adam

* update docstr

* add TODOs

* update CI

* fix CI

* fix CI

* fix CI path

* fix CI path

* fix CI path

* fix install tensornvme

* fix CI

* fix CI path

* fix CI env variables

* test CI

* test CI

* fix CI

* fix nvme optim __del__

* fix adam __del__

* fix nvme optim

* fix CI env variables

* fix nvme optim import

* test CI

* test CI

* fix CI

* [workflow] added regular 8 GPU testing

* polish workflow

* [test] ignore 8 gpu test

* polish code

* polish workflow

* polish workflow

* Update GitHub action and pre-commit settings

* Update GitHub action and pre-commit settings (#198)

* enable CI after PR sync

* Fixed github action