Commits · 01726ce2b8ec1adbffae7974b5bfe600962c2043 · OpenDAS / deepspeed

09 Sep, 2020 1 commit

Add 1-bit Adam support to DeepSpeed (#380) · 01726ce2

Ammar Ahmad Awan authored Sep 09, 2020



* 1-bit adam (#353)
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: tanghl1994 <htang14@ur.rochester.edu>
Co-authored-by: Hank <tanghl1994@gmail.com>
Co-authored-by: root <root@node2x12b.cs.rochester.edu>
Co-authored-by: Ammar Ahmad Awan <awan.ammar@microsoft.com>

01726ce2

02 Sep, 2020 1 commit

Sparse attn + ops/runtime refactor + v0.3.0 (#343) · e5bbc2e5

Jeff Rasley authored Sep 01, 2020



* Sparse attn + ops/runtime refactor + v0.3.0
Co-authored-by: Arash Ashari <arashari@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>

e5bbc2e5

22 Jul, 2020 1 commit
- Update setup.py (#298) · 871f7e63
  Jeff Rasley authored Jul 22, 2020
  
  871f7e63
29 May, 2020 1 commit

Transformer kernel release (#242) · 734d8991

Jeff Rasley authored May 29, 2020



* Transformer kernels release
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>

734d8991

12 Mar, 2020 1 commit

PyTorch 1.3+ build support (#135) · 3d3f8d36

Jeff Rasley authored Mar 12, 2020

* add support for torch 1.3+ builds inside a docker build environment
* remove apex imports

3d3f8d36

10 Feb, 2020 1 commit
- Moving to major/minor/patch versioning. (#51) · 50ae149f
  Shaden Smith authored Feb 09, 2020
  
  50ae149f
09 Feb, 2020 1 commit
- Azure tutorial updates and cleanup (#43) · 20ff66a0
  Jeff Rasley authored Feb 08, 2020
  
  20ff66a0
03 Feb, 2020 1 commit
- updating formatting to pass yapf · a5acb5b2
  Jeff Rasley authored Feb 03, 2020
  
  a5acb5b2
31 Jan, 2020 1 commit
- Initial commit of setup · 26e5ecab
  Jeff Rasley authored Jan 31, 2020
  
  26e5ecab