examples/tests/trainer/test_trainer_ext.py · 6f84531e6175700c821da3523c720d2698455e7f · chenpangpang / transformers

Add support for ZeRO-2/3 and ZeRO-offload in fairscale (#10354) · 9d14be5c

Sylvain Gugger authored Feb 25, 2021



* Ass support for ZeRO-2/3 and ZeRO-offload in fairscale

* Quality

* Rework from review comments

* Add doc

* Apply suggestions from code review
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

* Address review comments
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

9d14be5c

test_trainer_ext.py 7.08 KB

Replace test_trainer_ext.py