tests/nn/data_parallel/test_features_sharded_ddp.py · d52d2186be03c94d31f67c896d204d7dcde0f682 · OpenDAS / fairscale

[perf][ShardedDDP] fp16 gradient reduce (#411) · d52d2186

Benjamin Lefaudeux authored Feb 22, 2021

* POC, testing against the DDP comm hook when available
* docs, adding a reference to DDP's compress hook
* updating changelog, prep for v0.1.8 release

d52d2186

test_features_sharded_ddp.py 15.8 KB

Replace test_features_sharded_ddp.py