tests/deepspeed/test_deepspeed.py · 82efc53513a51660e629c7eca8210af1d67df00b · chenpangpang / transformers

Yell at the user if zero-3 init wasn't performed, but expected to have been done (#32299) · 82efc535

Zach Mueller authored Aug 01, 2024



* Test this zach

* Test for improper init w/o zero3

* Move back

* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Get rid of stars in warning

* Make private

* Make clear

---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

82efc535

test_deepspeed.py 56.2 KB

Replace test_deepspeed.py