Commits · 7d91be97652b464d389c7aa39a3a657a88f2d181 · OpenDAS / deepspeed

"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "60414f31a9a67ade65d90191c0b8349a189978a6"

16 Sep, 2020 1 commit

Olatunji Ruwase authored Sep 16, 2020



* Update installation instructions

* Format fix

* ZeRO tutorial

* Format fixes

* ZeRO-Offload

* ZeRO and ZeRO-Offload tutorials

* Update navigation page

* Format fixes

* Add yuxhe feedback

* Fix blog post link

* Fix OneBit-Adam link
Tweak scheduler example

* Fix date link
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

7d91be97

10 Sep, 2020 7 commits
- Update news site with press release link · 5dc4d6c7
  Jeff Rasley authored Sep 10, 2020
  
  5dc4d6c7
- bump DSE and doc tweak · 4b1df25a
  Jeff Rasley authored Sep 10, 2020
  
  4b1df25a
- Website edits (#398) · 6bb5c69f
  Shaden Smith authored Sep 10, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  6bb5c69f
- Landing page updates (#395) · a8a8b3d2
  Jeff Rasley authored Sep 10, 2020
```
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
```
  a8a8b3d2
- Adding sparse attention news index item (#376) · c76769c4
  Arash Ashari authored Sep 10, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  c76769c4
- Minjiaz/zero offload (#382) · 59ce90d0
  Minjia Zhang authored Sep 10, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  59ce90d0
- Update documentation for 1-bit Adam (#388) · 093f09ff
  Ammar Ahmad Awan authored Sep 10, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  093f09ff
09 Sep, 2020 1 commit
- fixing a link issue with SA tutorial (#387) · 161e8e60
  Arash Ashari authored Sep 09, 2020
```
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
```
  161e8e60
06 Sep, 2020 1 commit

Update Sparse Attention Tutorial (#357) · 9dadf38d

Arash Ashari authored Sep 06, 2020



* adding BingSqaud e2e test

* updating the draft test; bring final step under try section

* finalizinf test for base deepspeed and deepspeed with ZeRO

* applying the comment (thanks Jeff); fixed formatting

* update Sparse Attention Tutorial

* fixed few issues and applied comments for better organization and readability

* updated sparse attention tutorial with making how to use section incremental; applying more comments
Co-authored-by: arashashari <arashashari@ArashMSLaptop.redmond.corp.microsoft.com>

9dadf38d

02 Sep, 2020 1 commit

Sparse attn + ops/runtime refactor + v0.3.0 (#343) · e5bbc2e5

Jeff Rasley authored Sep 01, 2020



* Sparse attn + ops/runtime refactor + v0.3.0
Co-authored-by: Arash Ashari <arashari@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>

e5bbc2e5

07 Aug, 2020 1 commit
- Add webinar link (#309) · 29c5fe26
  Jeff Rasley authored Aug 07, 2020
```
Add webinar on-demand links and update readme
```
  29c5fe26
25 Jul, 2020 1 commit
- DeepSpeed webinar announcement (#301) · 7ae8f8bc
  Shaden Smith authored Jul 24, 2020
  
  7ae8f8bc
16 Jun, 2020 1 commit

add the fine-tuning results (#260) · 6e87251c

RezaYazdaniAminabadi authored Jun 16, 2020

* add the fine-tuning results

* updating tutorial and blog-post

* updated the tutorials and links

6e87251c

29 May, 2020 3 commits

center images (#244) · 0c77f878
Shaden Smith authored May 29, 2020

0c77f878
Image links (#243) · c7d0b0ca
Shaden Smith authored May 29, 2020

c7d0b0ca

Transformer kernel release (#242) · 734d8991

Jeff Rasley authored May 29, 2020



* Transformer kernels release
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>

734d8991

19 May, 2020 4 commits

Adds links to new blog. (#221) · 1230e31b
Shaden Smith authored May 19, 2020

1230e31b
News edits (#220) · 4eade17a
Shaden Smith authored May 19, 2020
```
* BERT title
```
4eade17a
news edits (#219) · 0c824830
Shaden Smith authored May 19, 2020

0c824830

ZeRO-2 (#217) · f2ac7eaf

Jeff Rasley authored May 19, 2020



Updates for ZeRO stage 2 + ZeRO stage 1 w. RS
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: yuxionghe <yuxhe@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>

f2ac7eaf

18 Mar, 2020 1 commit
- Web edits (#146) · 4d735946
  Shaden Smith authored Mar 17, 2020
```
* Add coming soon to posts

* Add what's new section to main page
```
  4d735946
17 Mar, 2020 1 commit
- drafting Jekyll webpage (#143) · 5042dc00
  Shaden Smith authored Mar 17, 2020
  
  5042dc00