Add distributed optimizer

9c742695 · Thor Johnsen · 8759ce0c · 9c742695
Commit 9c742695 authored Mar 12, 2020 by Thor Johnsen
Expand all Hide whitespace changes
Inline Side-by-side

Showing with 529 additions and 0 deletions

apex/contrib/optimizers/distributed_fused_adam.py apex/contrib/optimizers/distributed_fused_adam.py +529 -0

No files found.
--- a/apex/contrib/optimizers/distributed_fused_adam.py
+++ b/apex/contrib/optimizers/distributed_fused_adam.py