"vscode:/vscode.git/clone" did not exist on "96c4daabc162c3c05fe602152ee2ab2d780c0e23"
  • Jeff Rasley's avatar
    ZeRO-1 tune max-elems + bug fix (#532) · 08c96a1b
    Jeff Rasley authored
    * zero-1 memory fix
    
    * auto-tune max elems per comm to reduce padding/comm intervals
    
    * clean-up and added previously missing reduction options
    
    * fix testing backing to work with torch1.7
    08c96a1b
common.py 3.89 KB