GitLab

* [example] add zero1 and zero2 for GPT

* update readme in gpt example

* polish code

* change init value

* update readme

* [sc] add examples for auto checkpoint.

* merge upstream

* [fx] add more meta_registry for MetaTensor execution.

* update roberta

* update roberta & readme

* update roberta & readme

* update roberta & readme

* [example] enhence GPT demo

* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>

* [ColoTensor] ColoInitContext initialize parameters in shard mode.

* polish

* [example] add vit

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* [sc] modify auto checkpoint benchmark

* [sc] remove imgs

* [sc] remove redundant handson

* [tutorial] polish README and OPT files

* [tutorial] polish README and OPT files

* [tutorial] polish README and OPT files

* [tutorial] updated hybrid parallel readme

* polish code

* [tutorial] added synthetic data for sequence parallel

* polish code

* [tutorial] removed tutorial index in readme

* [tutorial] removed tutorial index in readme

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* [sc] modify auto checkpoint benchmark

* [sc] remove imgs

* [tutorial] added synthetic data for hybrid parallel

* polish code

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* add cifar10 dadasets

* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>

* Add handson to ColossalAI.

* Change names of handsons and edit sequence parallel example.

* Edit wrong folder name

* resolve conflict

* delete readme