• Deyu Fu's avatar
    Fix issues in fused_dam (#469) · 7fa74925
    Deyu Fu authored
    * move import of amp_C to __init__()
    
    * make fp16/32 separate lists to support mixed param types, disable double test
    
    * make zero_grad consistent between adam/novograd/lamb
    7fa74925
test_adam.py 6.22 KB