1. 24 Jun, 2022 1 commit
    • nv-dlasalle's avatar
      [Performance][Optimizer] Enable using UVA and FP16 with SparseAdam Optimizer (#3885) · 020f0249
      nv-dlasalle authored
      
      
      * Add uva by default to embedding
      
      * More updates
      
      * Update optimizer
      
      * Add new uva functions
      
      * Expose new pinned memory function
      
      * Add unit tests
      
      * Update formatting
      
      * Fix unit test
      
      * Handle auto UVA case when training is on CPU
      
      * Allow per-embedding decisions for whether to use UVA
      
      * Address spares_optim.py comments
      
      * Remove unused templates
      
      * Update unit test
      
      * Use dgl allocate memory for pinning
      
      * allow automatically unpin
      
      * workaround for d2h copy with a different dtype
      
      * fix linting
      
      * update error message
      
      * update copyright
      Co-authored-by: default avatarXin Yao <xiny@nvidia.com>
      Co-authored-by: default avatarMinjie Wang <wmjlyjemaine@gmail.com>
      020f0249
  2. 16 Jul, 2021 1 commit