tests/test_gemini/update/test_zeroddp_state_dict.py · 0af793836c82ae5e9ee056caab91d9aafa781a43 · OpenDAS / ColossalAI

[zero] fix state_dict and load_state_dict for ddp ignored parameters (#2443) · 5521af78

HELSON authored Jan 11, 2023

* [ddp] add is_ddp_ignored

[ddp] rename to is_ddp_ignored

* [zero] fix state_dict and load_state_dict

* fix bugs

* [zero] update unit test for ZeroDDP

5521af78

test_zeroddp_state_dict.py 4.44 KB

Replace test_zeroddp_state_dict.py