GitLab

* Remove math.prod dependency

* Fix style

* Fix style

---------
Co-authored-by: Jiatong Han <jiatong.han@u.nus.edu>

* [autoparallel] find repeat blocks

* polish

* polish

* polish

* [hotfix] fix chunk size can not be divided

* [hotfix] use numpy for python3.8

Fix typos, `6.7 -> 6.7b`

Fix hpcaitech/ColossalAI#2851

* [autoparallel] non spmd meta information generator

* [autoparallel] patch meta information for non spmd nodes

* [autoparallel] patch meta information of torch.where

* [autoparallel] pre-commit modified

* [autoparallel] tanh meta information

* [autoparallel] remove redundant code

* [autoparallel] patch meta information of torch.nn.Dropout

* [chatgpt]fix train_rm bug with lora

* [chatgpt]support colossalai strategy to train rm

* fix pre-commit

* fix pre-commit 2

* [chatgpt]fix rm eval typo

* fix rm eval

* fix pre commit

* add support of saving ckpt in examples

* fix single-gpu save

* [cli] handled version check exceptions

* polish code

* [chatgpt]fix train_rm bug with lora

* [chatgpt]support colossalai strategy to train rm

* fix pre-commit

* fix pre-commit 2

* [chatgpt]fix rm eval typo

* fix rm eval

* fix pre commit

* [triton] added copyright information for flash attention

* polish code

* [autoparallel] tensor related meta information prototype

* [autoparallel] tensor related meta information

* [autoparallel] tensor related meta information

* [autoparallel] tensor related meta information

* [autoparallel] tensor related meta information

Co-authored-by: github-actions <github-actions@github.com>

* add lora

* format

* [chatgpt] add test checkpoint

* [chatgpt] test checkpoint use smaller model

Fixed typo on line 285 from "defualt" to "default"

* [hotfix] fix autoparallel zh docs

* polish

* polish

* [hotfix] add copyright for solver and device mesh

* add readme

* add alpa license

* polish

* [CI/CD] fix nightly release CD running on forker repo

* fix misunderstanding of dispatch

* remove some build condition, enable notify even when release failed

* [autoparallel] rotor solver refactor

* [autoparallel] rotor solver refactor

* [doc] update OPT serving

* [doc] update OPT serving

* [chatgpt] add save/load checkpoint sample code

* [chatgpt] add save/load checkpoint readme

* [chatgpt] refactor save/load checkpoint readme

* [chatgpt] startegy add prepare method

* [chatgpt] refactor examples

* [chatgpt] refactor strategy.prepare

* [chatgpt] support save/load checkpoint

* [chatgpt] fix unwrap actor

* [chatgpt] fix unwrap actor

* [autoparallel] embedding metainfo

* [autoparallel] fix function name in test_activation_metainfo

* [autoparallel] undo changes in activation metainfo and related tests

* Don't use `torch._six`

This is a private API which is gone after https://github.com/pytorch/pytorch/pull/94709

* Update common.py

* [doc] update OPT serving link

* [doc] update example and OPT serving link

* [doc] update example and OPT serving link