GitLab

* Remove some fp16 examples that don't converge

Default static loss scale of 1.0 (default value) for resnet50 doesn't converge. Either remove example or put static loss scale 128 on it, which is known to converge well.

* Update README.md

* WIP: update to support new RNN backend code

* small refactor

* add test for rnn w/ packed sequences

amp unit tests

* Add reducer class in parallel/distributed.

* Separate DDP and Reducer examples.

* Don't confuse DDP and reducer in example.

Handle set/get state for DDP, remove stream which cant be pickled.