2020-02-13-release.md

---
layout: single
title: "ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters"
date:   2020-02-13
link: https://www.microsoft.com/en-us/research/blog/zero-deepspeed-new-system-optimizations-enable-training-models-with-over-100-billion-parameters/
excerpt: "Developed by Microsoft AI & Research."
categories: news
---