Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
composable_kernel
Commits
a2b5c7ac
Commit
a2b5c7ac
authored
Feb 27, 2023
by
guangzlu
Browse files
modified run_batched_multihead_attention_forward.inc
parent
016f85bf
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
example/32_batched_gemm_scale_softmax_gemm/run_batched_multihead_attention_forward.inc
..._softmax_gemm/run_batched_multihead_attention_forward.inc
+3
-1
No files found.
example/32_batched_gemm_scale_softmax_gemm/run_batched_multihead_attention_forward.inc
View file @
a2b5c7ac
...
@@ -228,6 +228,7 @@ int run(int argc, char* argv[])
...
@@ -228,6 +228,7 @@ int run(int argc, char* argv[])
if
(
do_verification
)
if
(
do_verification
)
{
{
// run for storing z tensor
// run for storing z tensor
argument
=
gemm
.
MakeArgument
(
argument
=
gemm
.
MakeArgument
(
static_cast
<
ADataType
*>
(
a_device_buf
.
GetDeviceBuffer
()),
static_cast
<
ADataType
*>
(
a_device_buf
.
GetDeviceBuffer
()),
...
@@ -261,7 +262,8 @@ int run(int argc, char* argv[])
...
@@ -261,7 +262,8 @@ int run(int argc, char* argv[])
p_drop
,
// dropout ratio
p_drop
,
// dropout ratio
{
seed
,
offset
});
// dropout random seed and offset, offset should be at least the number
{
seed
,
offset
});
// dropout random seed and offset, offset should be at least the number
// of elements on a thread
// of elements on a thread
c_device_buf
.
SetZero
();
lse_device_buf
.
SetZero
();
invoker
.
Run
(
argument
,
StreamConfig
{
nullptr
,
false
});
invoker
.
Run
(
argument
,
StreamConfig
{
nullptr
,
false
});
c_device_buf
.
FromDevice
(
c_gs_ms_os_device_result
.
mData
.
data
());
c_device_buf
.
FromDevice
(
c_gs_ms_os_device_result
.
mData
.
data
());
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment