GitLab

* [builder] builder for scaled_upper_triang_masked_softmax

* add missing files

* fix a bug

* polish code

* [example] diffusion install from docker

* [example] add zero1 and zero2 for GPT

* update readme in gpt example

* polish code

* change init value

* update readme

* [sc] add examples for auto checkpoint.

* merge upstream

* [fx] add more meta_registry for MetaTensor execution.

* update roberta

* update roberta & readme

* update roberta & readme

* update roberta & readme

* [example] enhence GPT demo

* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>

* [ColoTensor] ColoInitContext initialize parameters in shard mode.

* polish

* [example] add vit

* [sc] SC tutorial for auto checkpoint

* [sc] polish examples

* [sc] polish readme

* [sc] polish readme and help information

* [sc] polish readme and help information

* [sc] modify auto checkpoint benchmark

* [sc] remove imgs

* [sc] remove redundant handson