fairscale/nn/data_parallel/fully_sharded_data_parallel.py · 40e7450f6fd1ba27a71c58da2b49cd19a46b7678 · OpenDAS / fairscale

[fix][FSDP] Add support for saving optimizer state with expert replication (#936) · 40e7450f

anj-s authored Feb 23, 2022

* checkpoint tests

* checkpoint tests

* fix tests

* lint fixes

* remove prints

* lint fixes

* add comments

* add changelog

* more cleanup

* lint fix

40e7450f

fully_sharded_data_parallel.py 125 KB

Replace fully_sharded_data_parallel.py