• Tim Moon's avatar
    Move distributed Adam unit test to contrib dir (#1406) · 57f890a7
    Tim Moon authored
    * Increase default bucket size in distributed Adam
    
    * Move distributed Adam unit test to contrib tests
    
    Integrate into unit testing framework
    
    * Tweak hyperparameters for dist Adam optimizer test
    
    Improves numerical stability so we can keep tight tolerances. Adopting suggestions from @crcrpar.
    
    * Use distributed test infrastructure in distributed Adam unit test
    
    Suggestion from @crcrpar.
    57f890a7
distributed_fused_adam.py 36.4 KB