Skip to content

GitLab

Unverified Commit b861e928 authored by Rick Ho's avatar Rick Ho Committed by GitHub
Browse files

Merge pull request #45 from laekov/fix_stream_column_reduce 

Fixed asynchronous streams in column reduce kernel call
parents c96f8863 2126b59a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
cuda/parallel_linear.cuh
View file @ b861e928
...@@ -146,7 +146,7 @@ void fmoe_cuda_linear_backward_impl( ...@@ -146,7 +146,7 @@ void fmoe_cuda_linear_backward_impl(
if (has_bias) { if (has_bias) {
column_reduce column_reduce
<<<grid_threads, block_threads, sizeof(scalar_t)*1024, smgr->stream(0)>>> <<<grid_threads, block_threads, sizeof(scalar_t)*1024, smgr->stream(i)>>>
( (
grad_output_buf + ptr * out_feat, grad_output_buf + ptr * out_feat,
grad_bias + i * out_feat, grad_bias + i * out_feat,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment