GitLab

* [ColoTensor] ColoInitContext initialize parameters in shard mode.

* polish

* [example] add vit

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* [sc] modify auto checkpoint benchmark

* [sc] remove imgs

* [sc] remove redundant handson

* [tutorial] polish README and OPT files

* [tutorial] polish README and OPT files

* [tutorial] polish README and OPT files

* [tutorial] updated hybrid parallel readme

* polish code

* [tutorial] added synthetic data for sequence parallel

* polish code

* [tutorial] removed tutorial index in readme

* [tutorial] removed tutorial index in readme

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* [sc] modify auto checkpoint benchmark

* [sc] remove imgs

* [tutorial] added synthetic data for hybrid parallel

* polish code

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* add cifar10 dadasets

* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>

* Add handson to ColossalAI.

* Change names of handsons and edit sequence parallel example.

* Edit wrong folder name

* resolve conflict

* delete readme

Co-authored-by: Boxiang Wang <boxiang.wang1@gmail.com>

Co-authored-by: github-actions <github-actions@github.com>

* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test

Merge for SC tutorial

* [fx] metainfo_trace as an API.

* [fx] add return.