GitLab

* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test

* fix Critic

* fix Critic

* fix Critic

* fix neglect of attention mask

* fix neglect of attention mask

* fix neglect of attention mask

* add return

---------
Co-authored-by: yangwenjun <yangwenjun@soyoung.com>
Co-authored-by: yangwjd <yangwjd@chanjet.com>

Co-authored-by: poe <poe@nemoramo>

* [doc] specified operating system requirement

* polish code

* [doc] update nvme offload doc

* [doc] add doc testing cmd and requirements

* [doc] add api reference

* [doc] add dependencies

* [hotfix] skip auto checkpointing tests

* fix test name issue

* [workflow] supported conda package installation in doc test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* [workflow] fixed the post-commit failure when no formatting needed

* polish code

* polish code

* polish code

This reverts commit 35c8f4ce.

Co-authored-by: github-actions <github-actions@github.com>

* [autoparallel] refactor sharding spec

* rename function name

* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* add checkpoint callback for chatgpt

* add save ckpt callbacks for ppo

---------
Co-authored-by: Fazzie-Maqianli <55798671+Fazziekey@users.noreply.github.com>

* fix lora bug

* polish

* fix lora gemini

* fix inference laod model bug

Co-authored-by: github-actions <github-actions@github.com>

* [doc] add ISC tutorial

* [doc] add ISC tutorial

* [doc] add ISC tutorial

* [doc] add ISC tutorial

* gh: move CONTRIBUTING to .github

* chore: move isort config to pyproject

* chore: move pytest config to pyproject

* chore: move yapf config to pyproject

* chore: move clang-format config to pre-commit

* [doc] add deepspeed citation and copyright

* [doc] add deepspeed citation and copyright

* [doc] add deepspeed citation and copyright

* [doc] added reference to related works

* polish code

Prevents `TypeError: category must be a Warning subclass, not 'str'`.

* [kernel] cached the op kernel and fixed version check

* polish code

* polish code

* fix lora bug

* polish

* fix lora gemini

* [chatgpt] making experience support dp

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update sampler

* [chatgpt] update example test ci

* [chatgpt] refactor sampler

* [chatgpt] update example test ci

Co-authored-by: github-actions <github-actions@github.com>

* [doc] update news

* [doc] update news

* fix lora bug

* polish

* [chatgpt] fix inference demo loading bug

* polish

* Update README.md

* fix README

* Update README.md

* Update README.md

---------
Co-authored-by: fastalgo <youyang@cs.berkeley.edu>
Co-authored-by: BlueRum <70618399+ht-zhou@users.noreply.github.com>

Co-authored-by: github-actions <github-actions@github.com>

* [DTensor] implementation of dtensor

* test layout convert

* polish

* [chatgpt] support inference example

* Create inference.sh

* Update README.md

* Delete inference.sh

* Update inference.py