GitLab

Summary:
Pull Request resolved: https://github.com/facebookresearch/d2go/pull/505

Fused optimizers can only be run on CUDA, so this change makes necessary changes to enable remote execution for GPU tests, following: https://www.internalfb.com/intern/wiki/Pytorch_Ecosystem_Foundation_(EcoF)/PyTorch_Training/PyTorch_Lightning/Getting_Started/Testing/Adding_GPU_Unit_tests_using_RE/

Reviewed By: ertrue

Differential Revision: D44113380

fbshipit-source-id: 34a06813a894f4de6e5731f78ef7f2cf11f18a06