GitLab

* [gemini] support don't scatter after inference

* [chat] update colossalai strategy

* [chat] fix opt benchmark

* [chat] update opt benchmark

* [gemini] optimize inference

* [test] add gemini inference test

* [chat] fix unit test ci

* [chat] fix ci

* [chat] fix ci

* [chat] skip checkpoint test

* [testing] add beit model

* [beit] fix bugs

* [beit] fix bugs

* [testing] fix bugs

* [Gemini] more tests for Gemini

* polish code

* [testing] fix testing models

* roll back

* [test] ignore 8 gpu test

* polish code

* polish workflow

* polish workflow

* polish test_gpt

* update op unit tests

* update test model

* add 1d vocab loss

* polish

* polish test_model

* polish

only process module's own parameters in Zero context

add zero hooks for all modules that contrain parameters

gather parameters only belonging to module itself

* refactored test with component func

* fixed bug