Commits · 01726ce2b8ec1adbffae7974b5bfe600962c2043 · OpenDAS / deepspeed

09 Sep, 2020 1 commit

Add 1-bit Adam support to DeepSpeed (#380) · 01726ce2

Ammar Ahmad Awan authored Sep 09, 2020



* 1-bit adam (#353)
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: tanghl1994 <htang14@ur.rochester.edu>
Co-authored-by: Hank <tanghl1994@gmail.com>
Co-authored-by: root <root@node2x12b.cs.rochester.edu>
Co-authored-by: Ammar Ahmad Awan <awan.ammar@microsoft.com>

01726ce2

06 Sep, 2020 1 commit

Update Sparse Attention Tutorial (#357) · 9dadf38d

Arash Ashari authored Sep 06, 2020



* adding BingSqaud e2e test

* updating the draft test; bring final step under try section

* finalizinf test for base deepspeed and deepspeed with ZeRO

* applying the comment (thanks Jeff); fixed formatting

* update Sparse Attention Tutorial

* fixed few issues and applied comments for better organization and readability

* updated sparse attention tutorial with making how to use section incremental; applying more comments
Co-authored-by: arashashari <arashashari@ArashMSLaptop.redmond.corp.microsoft.com>

9dadf38d

02 Sep, 2020 1 commit

Sparse attn + ops/runtime refactor + v0.3.0 (#343) · e5bbc2e5

Jeff Rasley authored Sep 01, 2020



* Sparse attn + ops/runtime refactor + v0.3.0
Co-authored-by: Arash Ashari <arashari@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>

e5bbc2e5

28 Jul, 2020 1 commit
- Fixing a typo (#303) · 97c54273
  Emmanuel Kahembwe authored Jul 28, 2020
  
  97c54273
24 Jun, 2020 1 commit

Improving deepspeed.ai website (#269) · 6379292c

Conglong Li authored Jun 23, 2020

* syntax/typo fix

* add README for documentation

* fix links

* update navigation

* typo fix

* docs readme fix

6379292c

17 Jun, 2020 1 commit
- new transformer pre-ln image (#268) · 2e6d93e0
  Shaden Smith authored Jun 17, 2020
  
  2e6d93e0
16 Jun, 2020 1 commit

add the fine-tuning results (#260) · 6e87251c

RezaYazdaniAminabadi authored Jun 16, 2020

* add the fine-tuning results

* updating tutorial and blog-post

* updated the tutorials and links

6e87251c

04 Jun, 2020 1 commit
- Features links (#252) · 2a1c5db1
  Shaden Smith authored Jun 04, 2020
```
* links and formatting
```
  2a1c5db1
03 Jun, 2020 1 commit
- Update paths; include information about submodule. (#250) · fd2a8fd5
  Ammar Ahmad Awan authored Jun 03, 2020
```
Co-authored-by: Ammar Ahmad Awan <ammar.awan@microsoft.com>
```
  fd2a8fd5
29 May, 2020 5 commits

Point BERT pretraining tutorial to new perf tuning. (#246) · b1ddea7f
Shaden Smith authored May 29, 2020

b1ddea7f
update bert images (#245) · c5c9aaaa
Jeff Rasley authored May 29, 2020

c5c9aaaa
Image links (#243) · c7d0b0ca
Shaden Smith authored May 29, 2020

c7d0b0ca
update bert tutorial · 6622de16
Jeff Rasley authored May 29, 2020

6622de16

Transformer kernel release (#242) · 734d8991

Jeff Rasley authored May 29, 2020



* Transformer kernels release
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>

734d8991

21 May, 2020 2 commits
- Tense fix (#225) · e62afbc8
  Shaden Smith authored May 21, 2020
  
  e62afbc8
- WIP tutorial warning (#224) · 00183ed5
  Shaden Smith authored May 21, 2020
  
  00183ed5
19 May, 2020 1 commit

ZeRO-2 (#217) · f2ac7eaf

Jeff Rasley authored May 19, 2020



Updates for ZeRO stage 2 + ZeRO stage 1 w. RS
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: yuxionghe <yuxhe@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>

f2ac7eaf

27 Apr, 2020 1 commit
- Moved environment variable docs. (#203) · a0cd61e8
  Shaden Smith authored Apr 27, 2020
  
  a0cd61e8
22 Apr, 2020 1 commit
- Fixes missing newline in code example (#201) · c014a55b
  Shaden Smith authored Apr 22, 2020
  
  c014a55b
10 Apr, 2020 1 commit
- Add BERT pretraining tutorial to navigation bar. (#190) · 4cbfcc75
  Shaden Smith authored Apr 10, 2020
  
  4cbfcc75
06 Apr, 2020 1 commit
- Ported BERT pre-training tutorial (#184) · 5fb22a05
  Shaden Smith authored Apr 06, 2020
  
  5fb22a05
18 Mar, 2020 3 commits
- JSON configuration cleanup. (#151) · 1496247a
  Shaden Smith authored Mar 18, 2020
```
* Better config filename

* Clean up configuration ToC
```
  1496247a
- Web edits (#147) · b84a1fa4
  Shaden Smith authored Mar 18, 2020
  
  b84a1fa4
- Web edits (#146) · 4d735946
  Shaden Smith authored Mar 17, 2020
```
* Add coming soon to posts

* Add what's new section to main page
```
  4d735946
17 Mar, 2020 1 commit
- drafting Jekyll webpage (#143) · 5042dc00
  Shaden Smith authored Mar 17, 2020
  
  5042dc00