Add alternate distributed optimizer implementation

f0448054 · Thor Johnsen · 4a01ff26 · f0448054
Commit f0448054 authored Apr 20, 2020 by Thor Johnsen
Expand all Show whitespace changes
Inline Side-by-side

Showing with 515 additions and 0 deletions

apex/contrib/optimizers/distributed_fused_adam_v2.py apex/contrib/optimizers/distributed_fused_adam_v2.py +515 -0

No files found.
--- a/apex/contrib/optimizers/distributed_fused_adam_v2.py
+++ b/apex/contrib/optimizers/distributed_fused_adam_v2.py