Skip to content

GitLab

Commit 8f7c0d11 authored by mshoeybi's avatar mshoeybi
Browse files

Merge branch 'main' into inference

parents a5bfc296 5478d67e
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
megatron/fused_kernels/layer_norm_cuda_kernel.cu
View file @ 8f7c0d11
...@@ -645,6 +645,8 @@ void cuComputeGradInput( ...@@ -645,6 +645,8 @@ void cuComputeGradInput(
k_grad_input[l] = static_cast<T>(f_grad_input); k_grad_input[l] = static_cast<T>(f_grad_input);
} }
} }
// prevent race where buf is written again before reads are done
__syncthreads();
} }
} }
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment