GitLab

* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test

* add unet test

* add bench

* update bench

* update bench

* init

* support vit

* move to cpu

* add cpu benchmark

* fix train_dummy

* fix train-prompts

* fix gpt-actor

* fix gpt-critic

* fix opt-critic

Co-authored-by: github-actions <github-actions@github.com>

* [doc] add Intel cooperation for biomedicine

* fix colo-stratergy

* polish

* fix lora

* fix ddp

* polish

* polish

Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* [kernel] added kernel loader to softmax autograd function

* [release] v0.2.6

* [hotfix] meta tensor default device.

* [siu] add experimental submodules to main branch.

* [siu]

* [siu]

* [analyzer] init.

* [analyzer] readme.

* [analyzer] readme.

* [analyzer] readme.

* [analyzer] readme.

* [test] add test.

* Update symbolic_trace.py

* mark skip tests.

* try except.

* try except.

* try except.

* s

* init

* init

* fix

* skip

* skip

---------
Co-authored-by: Daniel Shao <superdainiu@MININT-PVARVID.fareast.corp.microsoft.com>
Co-authored-by: Daniel Shao <superdainiu@Daniels-Mac.local>

support vit for autochunk
* support some new ops for vit
* fix some bugs
* add test for vit

1. Modify the README of stable diffusion
2. Fix the version of pytorch lightning&lightning and colossalai version to enable codes running successfully.

* [DTensor] refactor LayoutConverter for DTensor

* polish code

* polish docstring

Co-authored-by: github-actions <github-actions@github.com>

* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test

* fix Critic

* fix Critic

* fix Critic

* fix neglect of attention mask

* fix neglect of attention mask

* fix neglect of attention mask

* add return

---------
Co-authored-by: yangwenjun <yangwenjun@soyoung.com>
Co-authored-by: yangwjd <yangwjd@chanjet.com>

Co-authored-by: poe <poe@nemoramo>

* [doc] specified operating system requirement

* polish code

* [doc] update nvme offload doc

* [doc] add doc testing cmd and requirements

* [doc] add api reference

* [doc] add dependencies

* [hotfix] skip auto checkpointing tests

* fix test name issue

* [workflow] supported conda package installation in doc test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* [workflow] fixed the post-commit failure when no formatting needed

* polish code

* polish code

* polish code

This reverts commit 35c8f4ce.

Co-authored-by: github-actions <github-actions@github.com>

* [autoparallel] refactor sharding spec

* rename function name