Skip to content

GitLab

Commit 6212aa28 authored by Jiezhong Qiu's avatar Jiezhong Qiu
Browse files

update

parent 27af1828
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
pytorch/cuda/cuda_stream_manager.h
View file @ 6212aa28
...@@ -16,11 +16,13 @@ public: ...@@ -16,11 +16,13 @@ public:
which means pytorch always sets the correct device for us. which means pytorch always sets the correct device for us.
But for safety, we still manually set device to the desired one. But for safety, we still manually set device to the desired one.
*/ */
/*
int current_device; int current_device;
checkCudaErrors(cudaGetDevice(&current_device)); checkCudaErrors(cudaGetDevice(&current_device));
printf("CudaStreamManager construnctor called, get device %d, set device %d\n", current_device, device); printf("CudaStreamManager construnctor called, get device %d, set device %d\n", current_device, device);
*/
checkCudaErrors(cudaSetDevice(device)); checkCudaErrors(cudaSetDevice(device));
streams = new cudaStream_t[num_expert]; streams = new cudaStream_t[num_expert];
checkCudaErrors(cublasCreate(&handle)); checkCudaErrors(cublasCreate(&handle));
for (size_t i=0; i<num_expert; ++i) { for (size_t i=0; i<num_expert; ++i) {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment