Commits · 82cecf69c357af5946f0548d2516789cfe2d6933 · OpenDAS / deepspeed

19 Jan, 2021 1 commit
- add zero-offload paper (#680) · 82cecf69
  Jeff Rasley authored Jan 19, 2021
```
* Update README.md

* Update index.md
```
  82cecf69
15 Jan, 2021 3 commits
- doc fix (#651) · 7b07e123
  Stas Bekman authored Jan 15, 2021
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  7b07e123
- add missing config menu entries (#652) · e729a3fd
  Stas Bekman authored Jan 15, 2021
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  e729a3fd
- Add AdamW to the supported optimizers (#672) · c5e42641
  Stas Bekman authored Jan 15, 2021
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  c5e42641
08 Jan, 2021 1 commit
- document deepspeed.initialize() (#644) · 828d75ba
  Stas Bekman authored Jan 08, 2021
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  828d75ba
07 Jan, 2021 2 commits

Add deepspeed.init_distributed to RTD page (#645) · 4e2dc4e4
Jeff Rasley authored Jan 07, 2021
```
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
```
4e2dc4e4

Bump nokogiri from 1.10.10 to 1.11.0 in /docs (#630) · 8cea96dd

dependabot[bot] authored Jan 07, 2021

Bumps [nokogiri](https://github.com/sparklemotion/nokogiri) from 1.10.10 to 1.11.0.
- [Release notes](https://github.com/sparklemotion/nokogiri/releases)
- [Changelog](https://github.com/sparklemotion/nokogiri/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sparklemotion/nokogiri/compare/v1.10.10...v1.11.0

)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

8cea96dd

06 Jan, 2021 1 commit

Module replacement support (#586) · 44bd538b

Jeff Rasley authored Jan 06, 2021


Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

44bd538b

05 Jan, 2021 1 commit
- docs: minor spelling tweaks (#623) · 46d2e287
  brett koonce authored Jan 05, 2021
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  46d2e287
18 Dec, 2020 1 commit
- Ability to initialize distributed backend outside deepspeed runtime (#608) · 7435b2f1
  Jeff Rasley authored Dec 17, 2020
  
  7435b2f1
15 Dec, 2020 2 commits

Fixes for RTD build errors (#606) · 6380ee35
Jeff Rasley authored Dec 15, 2020
```
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
```
6380ee35

[doc] xref to hostfile discussion (#604) · 007466e5

Stas Bekman authored Dec 15, 2020

* [doc] xref to hostfile discussion

wasn't clear where to find what was meant by `hostfile` - so adding a link to where it's discussed.

* remove whitespace

007466e5

09 Dec, 2020 1 commit
- Add papers/videos to readme/website (#592) · 19acd6cf
  Jeff Rasley authored Dec 09, 2020
  
  19acd6cf
07 Dec, 2020 1 commit
- [build] make builder smarter and configurable wrt compute capabilities + docs (#578) · ce363d0e
  Stas Bekman authored Dec 07, 2020
  
  ce363d0e
02 Dec, 2020 1 commit
- [cifar tutorial] improve readability (#567) · 7a75f8b3
  Stas Bekman authored Dec 02, 2020
```
* [cifar tutorial] improve readability 
```
  7a75f8b3
28 Nov, 2020 1 commit

[doc] typo fix and clarification (#563) · 17f36f1b

Stas Bekman authored Nov 27, 2020

This PR:
* fixes a misspelled method name
* also `( () )` doesn't read too well, until one reads the code and understands that it's not a formatting bug. I proposed to simply say that it's a callable object.

17f36f1b

12 Nov, 2020 2 commits

Installation documentation updates. (#525) · d779bd53
Shaden Smith authored Nov 12, 2020
```
* Adds torch install requirement to documentation.

* build ops documentation
```
d779bd53

DeepSpeed JIT op + PyPI support (#496) · 31f46fee

Jeff Rasley authored Nov 12, 2020


Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>

31f46fee

11 Nov, 2020 1 commit

Update zero.md tutorial (#495) · 0ad4fd88

Samyam Rajbhandari authored Nov 11, 2020



* Update zero.md

Update to ZeRO tutorial to specify the use of activation checkpointing

* Update zero-offload.md

Use activation checkpointing with ZeRO-Offload
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

0ad4fd88

10 Nov, 2020 2 commits

PLD release (#513) · be1147c0

Olatunji Ruwase authored Nov 10, 2020



* Progressive layer dropping docs (#499)

* test

* Adding tutorial and news page for pld

* updating the tutorial and posts of PLD

* update the finetune tutorial

* Update PLD tutorial (#512)

* Update installation instructions

* Format fix

* ZeRO tutorial

* Format fixes

* ZeRO-Offload

* ZeRO and ZeRO-Offload tutorials

* Update navigation page

* Format fixes

* Add yuxhe feedback

* Fix blog post link

* Fix OneBit-Adam link
Tweak scheduler example

* Fix date link

* Add DeepSpeed_Adam

* Add PLD tutorial to navigation
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

* updating the pld docs

* DeepSpeed implementation of PLD (#508)

* DeepSpeed implementation of PLD

* Format fixes

* Formatting fixes

* Fix broken url

* Address PR feedback

* Bump DSE
Co-authored-by: Minjia Zhang <33713995+minjiaz@users.noreply.github.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Minjia Zhang <minjiaz@microsoft.com>

be1147c0

updating pld docs (#517) · e082d475
Minjia Zhang authored Nov 10, 2020

e082d475

09 Nov, 2020 2 commits
- Fix PLD news url (#515) · 41fb24b3
  Olatunji Ruwase authored Nov 09, 2020
```
* PLD documentation

* Formatting fixes

* Fix url bug
```
  41fb24b3
- PLD documentation (#514) · e351090c
  Olatunji Ruwase authored Nov 09, 2020
```
* PLD documentation

* Formatting fixes
```
  e351090c
30 Oct, 2020 1 commit

Add CPUAdam optimizer for zero-offload in deepspeed engine (#484) · f5aa2547

Reza Yazdani authored Oct 30, 2020



* add adamW to CPU-ADAM implementation

* supporting cpu-adam optimizer for zero-offload on deepspeed side

* bump DSE to match cpu-adam updates
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

f5aa2547

19 Oct, 2020 1 commit
- updating website dependencies (#475) · d720fdb6
  Shaden Smith authored Oct 19, 2020
  
  d720fdb6
12 Oct, 2020 1 commit
- fixing typo (#460) · e25f2a23
  Reza Yazdani authored Oct 12, 2020
  
  e25f2a23
10 Oct, 2020 1 commit

Add DeepSpeed_Adam optimizer (#468) · 23fc48f3

Olatunji Ruwase authored Oct 10, 2020



* Update installation instructions

* Format fix

* ZeRO tutorial

* Format fixes

* ZeRO-Offload

* ZeRO and ZeRO-Offload tutorials

* Update navigation page

* Format fixes

* Add yuxhe feedback

* Fix blog post link

* Fix OneBit-Adam link
Tweak scheduler example

* Fix date link

* Add DeepSpeed_Adam
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

23fc48f3

07 Oct, 2020 1 commit

gan tutorial (#462) · 2efea694

niumanar authored Oct 06, 2020



* gan tutorial

* formatting fix

* adding pointer to repo; adding navigation link
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

2efea694

25 Sep, 2020 2 commits
- link fix part two :-) (#441) · 6d176c45
  Shaden Smith authored Sep 25, 2020
  
  6d176c45
- Update pipeline.md (#439) · 0ca82156
  Haibin Lin authored Sep 24, 2020
  
  0ca82156
24 Sep, 2020 2 commits
- Update azure.md (#437) · 192cf7c8
  Conglong Li authored Sep 24, 2020
  
  192cf7c8
- Fix urls in tutorial (#436) · 5d40f006
  Conglong Li authored Sep 24, 2020
```
* url fix

* revert absolute path but keep some actual fix

* add real readme
```
  5d40f006
17 Sep, 2020 2 commits
- Fix few typos in the docs (#418) · c66f3881
  Gowtham Prudhvi authored Sep 17, 2020
  
  c66f3881
- readthedocs yaml configuration (#410) · 5812e845
  Shaden Smith authored Sep 16, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  5812e845
16 Sep, 2020 1 commit

Minor doc fixes (#417) · 7d91be97

Olatunji Ruwase authored Sep 16, 2020



* Update installation instructions

* Format fix

* ZeRO tutorial

* Format fixes

* ZeRO-Offload

* ZeRO and ZeRO-Offload tutorials

* Update navigation page

* Format fixes

* Add yuxhe feedback

* Fix blog post link

* Fix OneBit-Adam link
Tweak scheduler example

* Fix date link
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

7d91be97

10 Sep, 2020 5 commits
- readthedocs upgrade (#402) · c82756cd
  Shaden Smith authored Sep 10, 2020
  
  c82756cd
- Update ZeRO-Offload blog post link (#401) · d15015e9
  Olatunji Ruwase authored Sep 10, 2020
```
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  d15015e9
- Update news site with press release link · 5dc4d6c7
  Jeff Rasley authored Sep 10, 2020
  
  5dc4d6c7
- Update _config.yml · ea92ed29
  Jeff Rasley authored Sep 10, 2020
  
  ea92ed29
- bump DSE and doc tweak · 4b1df25a
  Jeff Rasley authored Sep 10, 2020
  
  4b1df25a