• nv-dlasalle's avatar
    [Performance][Optimizer] Enable using UVA and FP16 with SparseAdam Optimizer (#3885) · 020f0249
    nv-dlasalle authored
    
    
    * Add uva by default to embedding
    
    * More updates
    
    * Update optimizer
    
    * Add new uva functions
    
    * Expose new pinned memory function
    
    * Add unit tests
    
    * Update formatting
    
    * Fix unit test
    
    * Handle auto UVA case when training is on CPU
    
    * Allow per-embedding decisions for whether to use UVA
    
    * Address spares_optim.py comments
    
    * Remove unused templates
    
    * Update unit test
    
    * Use dgl allocate memory for pinning
    
    * allow automatically unpin
    
    * workaround for d2h copy with a different dtype
    
    * fix linting
    
    * update error message
    
    * update copyright
    Co-authored-by: default avatarXin Yao <xiny@nvidia.com>
    Co-authored-by: default avatarMinjie Wang <wmjlyjemaine@gmail.com>
    020f0249
uvm_array_op.h 659 Bytes