Commits · 0c77f878b67069baf3c5a066b32778c10a38db84 · OpenDAS / deepspeed

29 May, 2020 5 commits

center images (#244) · 0c77f878
Shaden Smith authored May 29, 2020

0c77f878
Image links (#243) · c7d0b0ca
Shaden Smith authored May 29, 2020

c7d0b0ca
update bert tutorial · 6622de16
Jeff Rasley authored May 29, 2020

6622de16
remove old img · dddc526e
Jeff Rasley authored May 29, 2020

dddc526e

Transformer kernel release (#242) · 734d8991

Jeff Rasley authored May 29, 2020



* Transformer kernels release
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>

734d8991

27 May, 2020 1 commit

add support for predivide as a config option (#235) · bc36b91d

Jeff Rasley authored May 27, 2020

* add support for predivide as a flag
* add predivide json config, remove allgather_disable (as it's not currently used anymore)

bc36b91d

26 May, 2020 1 commit
- updating website packages (#231) · 6a9d57f6
  Shaden Smith authored May 26, 2020
  
  6a9d57f6
25 May, 2020 1 commit
- fix redundant (#228) · b466e84e
  Chunyang Wen authored May 25, 2020
  
  b466e84e
21 May, 2020 2 commits
- Tense fix (#225) · e62afbc8
  Shaden Smith authored May 21, 2020
  
  e62afbc8
- WIP tutorial warning (#224) · 00183ed5
  Shaden Smith authored May 21, 2020
  
  00183ed5
19 May, 2020 4 commits

Adds links to new blog. (#221) · 1230e31b
Shaden Smith authored May 19, 2020

1230e31b
News edits (#220) · 4eade17a
Shaden Smith authored May 19, 2020
```
* BERT title
```
4eade17a
news edits (#219) · 0c824830
Shaden Smith authored May 19, 2020

0c824830

ZeRO-2 (#217) · f2ac7eaf

Jeff Rasley authored May 19, 2020



Updates for ZeRO stage 2 + ZeRO stage 1 w. RS
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: yuxionghe <yuxhe@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>

f2ac7eaf

27 Apr, 2020 1 commit
- Moved environment variable docs. (#203) · a0cd61e8
  Shaden Smith authored Apr 27, 2020
  
  a0cd61e8
22 Apr, 2020 2 commits
- Fixes missing newline in code example (#201) · c014a55b
  Shaden Smith authored Apr 22, 2020
  
  c014a55b
- README and RTD improvements. (#198) · dd166ee6
  Shaden Smith authored Apr 21, 2020
  
  dd166ee6
10 Apr, 2020 1 commit
- Add BERT pretraining tutorial to navigation bar. (#190) · 4cbfcc75
  Shaden Smith authored Apr 10, 2020
  
  4cbfcc75
06 Apr, 2020 1 commit
- Ported BERT pre-training tutorial (#184) · 5fb22a05
  Shaden Smith authored Apr 06, 2020
  
  5fb22a05
18 Mar, 2020 4 commits
- JSON configuration cleanup. (#151) · 1496247a
  Shaden Smith authored Mar 18, 2020
```
* Better config filename

* Clean up configuration ToC
```
  1496247a
- Fix permalinks (#149) · 29855c27
  Shaden Smith authored Mar 18, 2020
```
* fix docs permalink

* fix docs permalink
```
  29855c27
- Web edits (#147) · b84a1fa4
  Shaden Smith authored Mar 18, 2020
  
  b84a1fa4
- Web edits (#146) · 4d735946
  Shaden Smith authored Mar 17, 2020
```
* Add coming soon to posts

* Add what's new section to main page
```
  4d735946
17 Mar, 2020 3 commits
- Restoring CNAME (#145) · 85cc16ae
  Shaden Smith authored Mar 17, 2020
  
  85cc16ae
- drafting Jekyll webpage (#143) · 5042dc00
  Shaden Smith authored Mar 17, 2020
  
  5042dc00
- Create CNAME · 0b8d765a
  Shaden Smith authored Mar 17, 2020
  
  0b8d765a
10 Mar, 2020 1 commit
- Add missing link to list of schedulers (#125) · 8ad8a262
  Cola authored Mar 10, 2020
  
  8ad8a262
07 Mar, 2020 1 commit
- Fix typo (#123) · 40885599
  Olatunji Ruwase authored Mar 06, 2020
  
  40885599
20 Feb, 2020 1 commit
- Updating MPU docs (#92) · 2abef1ef
  Shaden Smith authored Feb 19, 2020
  
  2abef1ef
15 Feb, 2020 1 commit

Add requirements for cifar10 (#79) · bca23057

kouml authored Feb 15, 2020



* add install requirements command line

* add pillow library to fix version

* modify to uppercase
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

bca23057

12 Feb, 2020 1 commit
- Fix broken links in CIFAR (#69) · 4f0680c1
  Shaden Smith authored Feb 12, 2020
  
  4f0680c1
10 Feb, 2020 4 commits
- Ported LRRT tutorial (#45) · 92514ac5
  Shaden Smith authored Feb 10, 2020
  
  92514ac5
- Ported 1Cycle tutorial. (#47) · b8541d04
  Shaden Smith authored Feb 10, 2020
```
* Importing 1Cycle tutorial.

* image paths

* Added LR schedule figure

* line wrap

* lowercase name

* Updating README links

* typo
```
  b8541d04
- Doc edits, typos, etc. (#53) · 4eb20eb5
  Jeff Rasley authored Feb 10, 2020
  
  4eb20eb5
- Porting JSON config documentation (#52) · 46686c9a
  Shaden Smith authored Feb 09, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  46686c9a
09 Feb, 2020 2 commits
- Azure and local node documentation updates (#48) · 2f22ed2e
  Jeff Rasley authored Feb 09, 2020
  
  2f22ed2e
- Azure tutorial updates and cleanup (#43) · 20ff66a0
  Jeff Rasley authored Feb 08, 2020
  
  20ff66a0
08 Feb, 2020 1 commit
- Pointing docs to hosted HTML files for core API. (#41) · 11a426ac
  Shaden Smith authored Feb 07, 2020
  
  11a426ac
07 Feb, 2020 2 commits

Update MegatronGPT2Tutorial.md · c578113a
Samyam Rajbhandari authored Feb 07, 2020
```
adding figure caption
```
c578113a

Yuxiong doc edits (#38) · ddefa23b

Jeff Rasley authored Feb 07, 2020



* Added features.md and Getting Started guide.

* trimming newlines

* Adding hostfile discussion

* include/exclude emphasis

* Edits overview

* minor edits on the overview

* minor edits

* Fixing broken GPT2 links

* Clarify our relationship with Megatron-LM

* Update README.md

* Update README.md

* minor edits

* fix formatting
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: yuxionghe <yuxhe@microsoft.com>

ddefa23b