Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Uni-Core
Commits
f9e22d6e
Commit
f9e22d6e
authored
Aug 04, 2022
by
Guolin Ke
Browse files
fix a silly bug
parent
b0f52120
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
csrc/softmax_dropout/softmax_fast.h
csrc/softmax_dropout/softmax_fast.h
+1
-1
No files found.
csrc/softmax_dropout/softmax_fast.h
View file @
f9e22d6e
...
@@ -501,7 +501,7 @@ bool dispatch_softmax_forward(output_t *dst, output_t *dst_orig, const input_t *
...
@@ -501,7 +501,7 @@ bool dispatch_softmax_forward(output_t *dst, output_t *dst_orig, const input_t *
GetNumBlocks
(
block_size
,
rows
,
waves
,
&
grid_dim
);
GetNumBlocks
(
block_size
,
rows
,
waves
,
&
grid_dim
);
dim3
block
(
block_size
);
dim3
block
(
block_size
);
const
size_t
smem
=
cols
*
sizeof
(
acc_t
);
const
size_t
smem
=
cols
*
sizeof
(
acc_t
);
softmax_block_forward
<
input_t
,
output_t
,
acc_t
,
block_size
,
Need
AttnM
as
k
,
Need
Bi
as
><<<
grid_dim
,
block
,
smem
>>>
(
softmax_block_forward
<
input_t
,
output_t
,
acc_t
,
block_size
,
Need
Bi
as
,
Need
AttnM
as
k
><<<
grid_dim
,
block
,
smem
>>>
(
src
,
dst
,
attn_mask
,
bias
,
rows
,
cols
,
attn_inner_skip_batch
,
bias_batch_count
);
src
,
dst
,
attn_mask
,
bias
,
rows
,
cols
,
attn_inner_skip_batch
,
bias_batch_count
);
return
true
;
return
true
;
}
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment