- 11 Mar, 2021 1 commit
-
-
Cheng Li authored
* add optimizers and schedules to rtd * update ds website and fix links * add optimizers and schedules to rtd * update ds website and fix links * add flops profiler to rtd * fix Co-authored-by:Shaden Smith <Shaden.Smith@microsoft.com>
-
- 08 Mar, 2021 1 commit
-
-
Samyam Rajbhandari authored
* Squash stage3 v1 (#146) Co-authored-by:
Samyam <samyamr@microsoft.com> Co-authored-by:
Jeff Rasley <jerasley@microsoft.com> Co-authored-by:
Olatunji Ruwase <olruwase@microsoft.com> Co-authored-by:
Shaden Smith <ShadenTSmith@gmail.com> Co-authored-by:
eltonzheng <eltonz@microsoft.com> * Fix correctness bug (#147) * formatting fix (#150) * stage3 bugfix (API) update and simplified FP16 Z3 tests (#151) * fp16 Z3 API update and bugfix * revert debug change * ZeRO-3 detach and race condition bugfixes (#149) * trying out ZeRO-3 race condition fix * CUDA sync instead of stream * reduction stream sync * remove commented code * Fix optimizer state_dict KeyError (#148) Co-authored-by:
-
- 20 Feb, 2021 1 commit
-
-
Stas Bekman authored
Invalid param name Thanks.
-
- 11 Feb, 2021 1 commit
-
-
Cheng Li authored
* work on flops profiler tutorial * update flops profiler tutorial * add flops profiler tutorial and fix names * work on flops profiler tutorial * update flops profiler tutorial * add flops profiler tutorial and fix names * fix tailing ws * fix names * remove multistep profiling and update docs * fix cases where functionals and submodules coexist in a parent module, update readme * fix typo * always invoke post hook function * fix module flops sum and update tests * update tutorial
-
- 20 Jan, 2021 1 commit
-
-
Stas Bekman authored
Co-authored-by:
-
- 15 Jan, 2021 2 commits
-
-
Stas Bekman authored
Co-authored-by: -
Stas Bekman authored
Co-authored-by:
-
- 30 Oct, 2020 1 commit
-
-
Reza Yazdani authored
* add adamW to CPU-ADAM implementation * supporting cpu-adam optimizer for zero-offload on deepspeed side * bump DSE to match cpu-adam updates Co-authored-by:
-
- 10 Oct, 2020 1 commit
-
-
Olatunji Ruwase authored
* Update installation instructions * Format fix * ZeRO tutorial * Format fixes * ZeRO-Offload * ZeRO and ZeRO-Offload tutorials * Update navigation page * Format fixes * Add yuxhe feedback * Fix blog post link * Fix OneBit-Adam link Tweak scheduler example * Fix date link * Add DeepSpeed_Adam Co-authored-by:
-
- 16 Sep, 2020 1 commit
-
-
Olatunji Ruwase authored
* Update installation instructions * Format fix * ZeRO tutorial * Format fixes * ZeRO-Offload * ZeRO and ZeRO-Offload tutorials * Update navigation page * Format fixes * Add yuxhe feedback * Fix blog post link * Fix OneBit-Adam link Tweak scheduler example * Fix date link Co-authored-by:
-
- 10 Sep, 2020 2 commits
-
-
Olatunji Ruwase authored
Co-authored-by:
-
Ammar Ahmad Awan authored
Co-authored-by:
-
- 02 Sep, 2020 1 commit
-
-
Jeff Rasley authored
* Sparse attn + ops/runtime refactor + v0.3.0 Co-authored-by:
Arash Ashari <arashari@microsoft.com> Co-authored-by:
-
- 13 Jul, 2020 1 commit
-
-
Jeff Rasley authored
* add amp docs
-
- 29 May, 2020 1 commit
-
-
Samyam Rajbhandari authored
-
- 27 May, 2020 1 commit
-
-
Jeff Rasley authored
* add support for predivide as a flag * add predivide json config, remove allgather_disable (as it's not currently used anymore)
-
- 19 May, 2020 1 commit
-
-
Jeff Rasley authored
Updates for ZeRO stage 2 + ZeRO stage 1 w. RS Co-authored-by:
yuxionghe <yuxhe@microsoft.com> Co-authored-by:
-
- 18 Mar, 2020 3 commits
-
-
Shaden Smith authored
* Better config filename * Clean up configuration ToC
-
Shaden Smith authored
* fix docs permalink * fix docs permalink
-
Shaden Smith authored
-
