2020-02-13-release.md

---
title: "ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters"
date:   2020-02-13
link: https://www.microsoft.com/en-us/research/blog/ZeRO-deepspeed-new-system-optimizations-enable-training-models-with-over-100-billion-parameters/
excerpt: ""
tags: training ZeRO English
---