Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
composable_kernel
Commits
7409bc5d
"...composable_kernel-1.git" did not exist on "b491ebf38480bc0d6cb329ba6825dee610c59097"
Commit
7409bc5d
authored
Jan 06, 2023
by
ltqin
Browse files
add commits and fix maskdisabled
parent
57b856b3
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
2 deletions
+3
-2
example/32_batched_gemm_scale_softmax_gemm/batched_multihead_attention_backward_fp16.cpp
...oftmax_gemm/batched_multihead_attention_backward_fp16.cpp
+1
-1
include/ck/tensor_operation/gpu/grid/gridwise_batched_multihead_attention_backward_xdl_cshuffle_v1.hpp
..._batched_multihead_attention_backward_xdl_cshuffle_v1.hpp
+2
-1
No files found.
example/32_batched_gemm_scale_softmax_gemm/batched_multihead_attention_backward_fp16.cpp
View file @
7409bc5d
...
@@ -75,7 +75,7 @@ static constexpr auto MaskingSpec =
...
@@ -75,7 +75,7 @@ static constexpr auto MaskingSpec =
ck
::
tensor_operation
::
device
::
MaskingSpecialization
::
MaskOutUpperTriangle
;
ck
::
tensor_operation
::
device
::
MaskingSpecialization
::
MaskOutUpperTriangle
;
#else
#else
static
constexpr
auto
MaskingSpec
=
static
constexpr
auto
MaskingSpec
=
ck
::
tensor_operation
::
device
::
MaskingSpecialization
::
Mask
OutUpperTriang
le
;
ck
::
tensor_operation
::
device
::
MaskingSpecialization
::
Mask
Disab
le
d
;
#endif
#endif
static
constexpr
auto
TensorSpecQ
=
ck
::
tensor_operation
::
device
::
TensorSpecialization
::
Default
;
static
constexpr
auto
TensorSpecQ
=
ck
::
tensor_operation
::
device
::
TensorSpecialization
::
Default
;
...
...
include/ck/tensor_operation/gpu/grid/gridwise_batched_multihead_attention_backward_xdl_cshuffle_v1.hpp
View file @
7409bc5d
...
@@ -1267,7 +1267,8 @@ struct GridwiseBatchedMultiheadAttentionBackward_Xdl_CShuffle
...
@@ -1267,7 +1267,8 @@ struct GridwiseBatchedMultiheadAttentionBackward_Xdl_CShuffle
k_grid_desc_n0_k_n1
,
k_grid_desc_n0_k_n1
,
make_multi_index
(
0
,
o_block_data_idx_on_grid
,
0
),
make_multi_index
(
0
,
o_block_data_idx_on_grid
,
0
),
b1_element_op
,
b1_element_op
,
Gemm1
::
b_block_desc_bk0_n_bk1
,
Gemm1
::
b_block_desc_bk0_n_bk1
,
// there n actually is k, k is N, so name can be
// b_block_desc_bn0_k_bn1
make_multi_index
(
0
,
0
,
0
),
make_multi_index
(
0
,
0
,
0
),
tensor_operation
::
element_wise
::
PassThrough
{});
tensor_operation
::
element_wise
::
PassThrough
{});
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment