GitLab

* [example]update gemini examples

* [example]update gemini examples

* [zero] refactor low-level zero folder structure

* [zero] fix legacy zero import path

* [zero] fix legacy zero import path

* [zero] remove useless import

* [zero] refactor gemini folder structure

* [zero] refactor gemini folder structure

* [zero] refactor legacy zero import path

* [zero] refactor gemini folder structure

* [zero] refactor gemini folder structure

* [zero] refactor gemini folder structure

* [zero] refactor legacy zero import path

* [zero] fix test import path

* [zero] fix test

* [zero] fix circular import

* [zero] update import

* [zero] add strict ddp mode for chunk init

* [gemini] update gpt example

* [zero] add strict ddp mode

* [polish] add comments for strict ddp mode

* [zero] fix test error

* change the benchmark config file

* change config

* revert config file

* rename distpan to distplan

* [hotfix] fix gpt gemini example

* [example] add new assertions

* add benchmark

* merge common func

* add total and avg tflops
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [example] add zero1 and zero2 for GPT

* update readme in gpt example

* polish code

* change init value

* update readme

* [example] enhence GPT demo

* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>