Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
composable_kernel_ROCM
Commits
7d6258fa
"...composable_kernel.git" did not exist on "9f36ac7cfea63e01276426a62b7e4291ba6479d1"
Commit
7d6258fa
authored
Nov 28, 2024
by
Po Yen Chen
Browse files
Generate prefill combine instances only for group mode
parent
94802528
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
2 deletions
+3
-2
example/ck_tile/01_fmha/codegen/ops/fmha_fwd_splitkv.py
example/ck_tile/01_fmha/codegen/ops/fmha_fwd_splitkv.py
+3
-2
No files found.
example/ck_tile/01_fmha/codegen/ops/fmha_fwd_splitkv.py
View file @
7d6258fa
...
@@ -728,10 +728,11 @@ def get_fwd_splitkv_combine_blobs(kernel_filter : Optional[str], receipt) -> Lis
...
@@ -728,10 +728,11 @@ def get_fwd_splitkv_combine_blobs(kernel_filter : Optional[str], receipt) -> Lis
continue
continue
#for hdim_str, mode, mask, bias, lse in itertools.product(d.keys(), MODE_MAP.keys(), MASK_MAP.keys(), ["t", "f"], ["t", "f"]):
#for hdim_str, mode, mask, bias, lse in itertools.product(d.keys(), MODE_MAP.keys(), MASK_MAP.keys(), ["t", "f"], ["t", "f"]):
for
hdim_str
,
mode
in
itertools
.
product
(
d
.
keys
(),
MODE_MAP
.
keys
()):
for
hdim_str
,
mode
in
itertools
.
product
(
d
.
keys
(),
MODE_MAP
.
keys
()):
tiles
=
d
[
hdim_str
]
# include prefill tile size if in group mode
tiles
=
d
[
hdim_str
][
0
:
2
if
mode
==
'group'
else
1
]
hdim
=
int
(
hdim_str
)
hdim
=
int
(
hdim_str
)
for
tile
,
pipeline
in
itertools
.
product
(
tiles
,
get_pipelines
(
dtype
,
hdim
)):
for
tile
,
pipeline
in
itertools
.
product
(
tiles
,
get_pipelines
(
dtype
,
hdim
)):
if
mode
==
"
group
"
:
if
mode
==
'
group
'
:
if
pipeline
.
F_spad
!=
't'
:
if
pipeline
.
F_spad
!=
't'
:
# in group mode, spad/skpad must be true, since we can't predict if seqlen of current batch need pad or not
# in group mode, spad/skpad must be true, since we can't predict if seqlen of current batch need pad or not
continue
continue
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment