tests/test_tensor/test_zero_optim.py · 8106d7b8c73c23877a9bc75d8a66c2631a5b930d · OpenDAS / ColossalAI

ver217 authored Jun 21, 2022

* ColoDDP supports overwriting default process group

* rename ColoDDPV2 to ZeroDDP

* add docstr for ZeroDDP

* polish docstr

8106d7b8

test_zero_optim.py 5.45 KB