GitLab

Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* [kernel] added kernel loader to softmax autograd function

* [release] v0.2.6

* [hotfix] meta tensor default device.

* [siu] add experimental submodules to main branch.

* [siu]

* [siu]

* [analyzer] init.

* [analyzer] readme.

* [analyzer] readme.

* [analyzer] readme.

* [analyzer] readme.

* [test] add test.

* Update symbolic_trace.py

* mark skip tests.

* try except.

* try except.

* try except.

* s

* init

* init

* fix

* skip

* skip

---------
Co-authored-by: Daniel Shao <superdainiu@MININT-PVARVID.fareast.corp.microsoft.com>
Co-authored-by: Daniel Shao <superdainiu@Daniels-Mac.local>

support vit for autochunk
* support some new ops for vit
* fix some bugs
* add test for vit

1. Modify the README of stable diffusion
2. Fix the version of pytorch lightning&lightning and colossalai version to enable codes running successfully.

* [DTensor] refactor LayoutConverter for DTensor

* polish code

* polish docstring

Co-authored-by: github-actions <github-actions@github.com>

* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test

* fix Critic

* fix Critic

* fix Critic

* fix neglect of attention mask

* fix neglect of attention mask

* fix neglect of attention mask

* add return

---------
Co-authored-by: yangwenjun <yangwenjun@soyoung.com>
Co-authored-by: yangwjd <yangwjd@chanjet.com>

Co-authored-by: poe <poe@nemoramo>

* [doc] specified operating system requirement

* polish code

* [doc] update nvme offload doc

* [doc] add doc testing cmd and requirements

* [doc] add api reference

* [doc] add dependencies

* [hotfix] skip auto checkpointing tests

* fix test name issue

* [workflow] supported conda package installation in doc test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* [workflow] fixed the post-commit failure when no formatting needed

* polish code

* polish code

* polish code

This reverts commit 35c8f4ce.

Co-authored-by: github-actions <github-actions@github.com>

* [autoparallel] refactor sharding spec

* rename function name

* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* add checkpoint callback for chatgpt

* add save ckpt callbacks for ppo

---------
Co-authored-by: Fazzie-Maqianli <55798671+Fazziekey@users.noreply.github.com>

* fix lora bug

* polish

* fix lora gemini

* fix inference laod model bug

Co-authored-by: github-actions <github-actions@github.com>

* [doc] add ISC tutorial

* [doc] add ISC tutorial

* [doc] add ISC tutorial

* [doc] add ISC tutorial

* gh: move CONTRIBUTING to .github

* chore: move isort config to pyproject

* chore: move pytest config to pyproject

* chore: move yapf config to pyproject

* chore: move clang-format config to pre-commit

* [doc] add deepspeed citation and copyright

* [doc] add deepspeed citation and copyright

* [doc] add deepspeed citation and copyright