tests/nn/data_parallel/test_sharded_ddp.py · 49a198c99cdf61cf869ced2dc1e4e8b69926ceed · OpenDAS / fairscale

[feat] Sharded DDP - small refactor and new features (#97) · 49a198c9

Benjamin Lefaudeux authored Sep 17, 2020

- rename oss_ddp to ShardedDataParallel
- some refactoring
- ShardedDataParallel owns the sharded optimizer, exposed if need be
- some small perf bumps

49a198c9

test_sharded_ddp.py 3.18 KB

Replace test_sharded_ddp.py