Skip to content

GitLab

Switch branch/tag
  1. 22 May, 2021 1 commit
    • Zhicheng Yan's avatar
      support FP16 gradient compression · 57809b0f
      Zhicheng Yan authored 
      Summary:
Pull Request resolved: https://github.com/facebookresearch/d2go/pull/70

DDP supports an fp16_compress_hook which compresses the gradient to FP16 before communication. This can result in a significant speed up.

Add one argument `_C.MODEL.DDP_FP16_GRAD_COMPRESS` to trigger it.

Reviewed By: zhanghang1989

Differential Revision: D28467701

fbshipit-source-id: 3c80865222f48eb8fe6947ea972448c445ee3ef3
      57809b0f
  3. 03 Mar, 2021 1 commit