Commits · ab5fd127e393f7298c6497fd638d0f89c53a9452 · OpenDAS / ColossalAI

"docs/source/vscode:/vscode.git/clone" did not exist on "7bc5a8e338a1240070ca82f96721c451060f1a70"

07 Apr, 2023 1 commit
- [example] update roberta with newer ColossalAI (#3472) · ab5fd127
  mandoxzhang authored Apr 07, 2023
```
* update roberta example

* update roberta example
```
  ab5fd127
06 Apr, 2023 1 commit

[test] refactor tests with spawn (#3452) · 80eba05b

Frank Lee authored Apr 06, 2023

* [test] added spawn decorator

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

80eba05b

04 Apr, 2023 2 commits

[example] update examples related to zero/gemini (#3431) · 573af841

ver217 authored Apr 04, 2023

* [zero] update legacy import

* [zero] update examples

* [example] fix opt tutorial

* [example] fix opt tutorial

* [example] fix opt tutorial

* [example] fix opt tutorial

* [example] fix import

573af841

[zero] reorganize zero/gemini folder structure (#3424) · 26b7aac0

ver217 authored Apr 04, 2023

* [zero] refactor low-level zero folder structure

* [zero] fix legacy zero import path

* [zero] fix legacy zero import path

* [zero] remove useless import

* [zero] refactor gemini folder structure

* [zero] refactor gemini folder structure

* [zero] refactor legacy zero import path

* [zero] refactor gemini folder structure

* [zero] refactor gemini folder structure

* [zero] refactor gemini folder structure

* [zero] refactor legacy zero import path

* [zero] fix test import path

* [zero] fix test

* [zero] fix circular import

* [zero] update import

26b7aac0

23 Mar, 2023 1 commit
- [auto] fix requirements typo for issue #3125 (#3209) · 18934796
  Yan Fang authored Mar 23, 2023
  
  18934796
21 Mar, 2023 1 commit

[auto-parallel] add auto-offload feature (#3154) · 18dbe76c

Zihao authored Mar 21, 2023

* add auto-offload feature

* polish code

* fix syn offload runtime pass bug

* add offload example

* fix offload testing bug

* fix example testing bug

18dbe76c

09 Mar, 2023 2 commits
- [example] fix redundant note (#3065) · 36067428
  binmakeswell authored Mar 09, 2023
  
  36067428
- [example] fixed opt model downloading from huggingface · af388848
  Tomek authored Mar 09, 2023
  
  af388848
08 Mar, 2023 1 commit
- support shardinit option to avoid OPT OOM initializing problem (#3037) · 2ef855c7
  ramos authored Mar 08, 2023
```
Co-authored-by: poe <poe@nemoramo>
```
  2ef855c7
07 Mar, 2023 1 commit

[pipeline] Add Simplified Alpa DP Partition (#2507) · 400f6301

Ziyue Jiang authored Mar 07, 2023



* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

400f6301

27 Feb, 2023 2 commits
- [format] applied code formatting on changed files in pull request 2922 (#2923) · da056285
  github-actions[bot] authored Feb 27, 2023
```
Co-authored-by: github-actions <github-actions@github.com>
```
  da056285
- [doc] update installation for GPT (#2922) · 12bafe05
  binmakeswell authored Feb 27, 2023
  
  12bafe05
22 Feb, 2023 2 commits
- Fix typos (#2863) · a4fc125c
  Alex_996 authored Feb 22, 2023
```
Fix typos, `6.7 -> 6.7b`
```
  a4fc125c
- [doc] fix GPT tutorial (#2860) · 55424a16
  dawei-wang authored Feb 21, 2023
```
Fix hpcaitech/ColossalAI#2851
```
  55424a16
20 Feb, 2023 1 commit
- [exmaple] add bert and albert (#2824) · bf020460
  Jiarui Fang authored Feb 20, 2023
  
  bf020460
15 Feb, 2023 1 commit
- [doc] fixed a typo in GPT readme (#2736) · 43dffdab
  cloudhuang authored Feb 15, 2023
  
  43dffdab
09 Feb, 2023 1 commit
- [example] Polish README.md (#2658) · a255a38f
  Jiatong (Julius) Han authored Feb 09, 2023
```
* [tutorial] polish readme.md

* [example] Update README.md
```
  a255a38f
31 Jan, 2023 1 commit
- [gemini] add profiler in the demo (#2534) · 6e0faa70
  HELSON authored Jan 31, 2023
  
  6e0faa70
30 Jan, 2023 1 commit
- [gemini] update the gpt example (#2527) · 66dfcf52
  HELSON authored Jan 30, 2023
  
  66dfcf52
28 Jan, 2023 1 commit
- [gemini] update ddp strict mode (#2518) · 707b11d4
  HELSON authored Jan 28, 2023
```
* [zero] add strict ddp mode for chunk init

* [gemini] update gpt example
```
  707b11d4
20 Jan, 2023 1 commit

[zero] add strict ddp mode (#2508) · 2d1a7dfe

HELSON authored Jan 20, 2023

* [zero] add strict ddp mode

* [polish] add comments for strict ddp mode

* [zero] fix test error

2d1a7dfe

18 Jan, 2023 3 commits
- [hotfix] gpt example titans bug #2493 (#2494) · e327e951
  Jiarui Fang authored Jan 18, 2023
  
  e327e951
- polish code and fix dataloader bugs · e58cc441
  jiaruifang authored Jan 18, 2023
  
  e58cc441
- [hotfix] gpt example titans bug #2493 · a4b75b78
  jiaruifang authored Jan 18, 2023
  
  a4b75b78
17 Jan, 2023 1 commit
- [example] fix requirements (#2488) · fcc6d61d
  binmakeswell authored Jan 17, 2023
  
  fcc6d61d
16 Jan, 2023 8 commits
- [example] titans for gpt (#2484) · 3a21485e
  Jiarui Fang authored Jan 16, 2023
  
  3a21485e
- update readme · 438ea608
  jiaruifang authored Jan 16, 2023
  
  438ea608
- polish code · 38424db6
  jiaruifang authored Jan 16, 2023
  
  38424db6
- remove license · 92f65fbb
  jiaruifang authored Jan 16, 2023
  
  92f65fbb
- polish readme · 315e1433
  jiaruifang authored Jan 16, 2023
  
  315e1433
- [example] titans for gpt · 37baea20
  jiaruifang authored Jan 16, 2023
  
  37baea20
- polish code · e64a05b3
  jiaruifang authored Jan 16, 2023
  
  e64a05b3
- [CI] add test_ci.sh for palm, opt and gpt (#2475) · 7c317062
  Jiarui Fang authored Jan 16, 2023
  
  7c317062
13 Jan, 2023 3 commits
- [example] update gpt gemini example ci test (#2477) · f525d1f5
  ver217 authored Jan 13, 2023
  
  f525d1f5
- polish pp middleware (#2476) · fef5c949
  Ziyue Jiang authored Jan 13, 2023
```
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
```
  fef5c949
- [zero] low level optim supports ProcessGroup (#2464) · 867c8c2d
  Jiarui Fang authored Jan 13, 2023
  
  867c8c2d
11 Jan, 2023 1 commit

[autoparallel] integrate device mesh initialization into autoparallelize (#2393) · 2731531b

YuliangLiu0306 authored Jan 11, 2023

* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost

2731531b

10 Jan, 2023 2 commits
- [examples] adding tflops to PaLM (#2365) · fe0f7970
  ZijianYY authored Jan 10, 2023
  
  fe0f7970
- [hotfix] add DISTPAN argument for benchmark (#2412) · d84e7479
  HELSON authored Jan 10, 2023
```
* change the benchmark config file

* change config

* revert config file

* rename distpan to distplan
```
  d84e7479
09 Jan, 2023 1 commit
- [hotfix] fix gpt gemini example (#2404) · 498b5ca9
  HELSON authored Jan 09, 2023
```
* [hotfix] fix gpt gemini example

* [example] add new assertions
```
  498b5ca9