GitLab

* update roberta

* update roberta & readme

* update roberta & readme

* update roberta & readme

* [autoparallel] support distributed dataloader option

* update output handler to support ddp dataloader

* poish code

* Add alpha beta

* Fix test

* Fix test

* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input

* [fx] patch addmm

* [autoparallel] support addmm in tracer and solver

* [example] enhence GPT demo

* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>

update model download in README

* [ColoTensor] ColoInitContext initialize parameters in shard mode.

* polish

* [example] add vit

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* [sc] modify auto checkpoint benchmark

* [sc] remove imgs

* [sc] remove redundant handson

* [tutorial] polish README and OPT files

* [tutorial] polish README and OPT files

* [tutorial] polish README and OPT files

* [tutorial] updated hybrid parallel readme

* polish code

* [tutorial] added synthetic data for sequence parallel

* polish code

* [tutorial] removed tutorial index in readme

* [tutorial] removed tutorial index in readme

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* [sc] modify auto checkpoint benchmark

* [sc] remove imgs

* [tutorial] added synthetic data for hybrid parallel

* polish code