[Core][Distributed] use existing torch.cuda.device context manager (#4318)
Attach a file by drag & drop or click to upload
