Commits · 59ce90d0d47bbbc85abfa6970dbdc7f9b5ea185b · OpenDAS / deepspeed

10 Sep, 2020 4 commits

Minjiaz/zero offload (#382) · 59ce90d0
Minjia Zhang authored Sep 10, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
59ce90d0
Sparse attention: updating code tag in documentation (#394) · be4b94be
Arash Ashari authored Sep 10, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
be4b94be
Update documentation for 1-bit Adam (#388) · 093f09ff
Ammar Ahmad Awan authored Sep 10, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
093f09ff

Jeff Rasley authored Sep 09, 2020



* ZeRO-Offload (squash) (#381)
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Jie <37380896+jren73@users.noreply.github.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: arashashari <arashashari@ArashMSLaptop.redmond.corp.microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>

41db1c2f

09 Sep, 2020 1 commit
- adding sparse attention to feature index page (#377) · b73894de
  Arash Ashari authored Sep 08, 2020
  
  b73894de
24 Jun, 2020 1 commit

Improving deepspeed.ai website (#269) · 6379292c

Conglong Li authored Jun 23, 2020

* syntax/typo fix

* add README for documentation

* fix links

* update navigation

* typo fix

* docs readme fix

6379292c

25 May, 2020 1 commit
- fix redundant (#228) · b466e84e
  Chunyang Wen authored May 25, 2020
  
  b466e84e
19 May, 2020 1 commit

ZeRO-2 (#217) · f2ac7eaf

Jeff Rasley authored May 19, 2020



Updates for ZeRO stage 2 + ZeRO stage 1 w. RS
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: yuxionghe <yuxhe@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>

f2ac7eaf

18 Mar, 2020 2 commits
- Web edits (#147) · b84a1fa4
  Shaden Smith authored Mar 18, 2020
  
  b84a1fa4
- Web edits (#146) · 4d735946
  Shaden Smith authored Mar 17, 2020
```
* Add coming soon to posts

* Add what's new section to main page
```
  4d735946
17 Mar, 2020 1 commit
- drafting Jekyll webpage (#143) · 5042dc00
  Shaden Smith authored Mar 17, 2020
  
  5042dc00
07 Mar, 2020 1 commit
- Fix typo (#123) · 40885599
  Olatunji Ruwase authored Mar 06, 2020
  
  40885599
20 Feb, 2020 1 commit
- Updating MPU docs (#92) · 2abef1ef
  Shaden Smith authored Feb 19, 2020
  
  2abef1ef
10 Feb, 2020 2 commits
- Ported LRRT tutorial (#45) · 92514ac5
  Shaden Smith authored Feb 10, 2020
  
  92514ac5
- Doc edits, typos, etc. (#53) · 4eb20eb5
  Jeff Rasley authored Feb 10, 2020
  
  4eb20eb5
08 Feb, 2020 1 commit
- Pointing docs to hosted HTML files for core API. (#41) · 11a426ac
  Shaden Smith authored Feb 07, 2020
  
  11a426ac
07 Feb, 2020 1 commit

Yuxiong doc edits (#38) · ddefa23b

Jeff Rasley authored Feb 07, 2020



* Added features.md and Getting Started guide.

* trimming newlines

* Adding hostfile discussion

* include/exclude emphasis

* Edits overview

* minor edits on the overview

* minor edits

* Fixing broken GPT2 links

* Clarify our relationship with Megatron-LM

* Update README.md

* Update README.md

* minor edits

* fix formatting
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: yuxionghe <yuxhe@microsoft.com>

ddefa23b