tests/nn/data_parallel/test_sharded_ddp.py · 13445c555aa459bf10b5be9f496937acaca72006 · OpenDAS / fairscale

[feature-fix-refactor][ShardedDDP] Make it possible to change trainability graph on the fly (#369) · 13445c55

Benjamin Lefaudeux authored Feb 11, 2021

* Better unit testing
* Make it possible to refresh the DDP assumptions when the model has changed. Make it optional so that you save some time
* Enabling accumulation tests

13445c55

test_sharded_ddp.py 21 KB

Replace test_sharded_ddp.py