Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
composable_kernel_ROCM
Commits
6401c4cb
Commit
6401c4cb
authored
Nov 14, 2024
by
letaoqin
Browse files
change input parameters
parent
16dc96eb
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
5 deletions
+5
-5
example/ck_tile/16_fused_moe_general/main.cpp
example/ck_tile/16_fused_moe_general/main.cpp
+5
-5
No files found.
example/ck_tile/16_fused_moe_general/main.cpp
View file @
6401c4cb
...
...
@@ -88,12 +88,12 @@ auto create_args(int argc, char* argv[])
ck_tile
::
ArgParser
arg_parser
;
arg_parser
.
insert
(
"t"
,
"128"
,
"num input tokens"
)
.
insert
(
"e"
,
"32"
,
"num of experts"
)
.
insert
(
"k"
,
"
5
"
,
"topk"
)
.
insert
(
"h"
,
"
819
2"
,
"hidden_size of this model"
)
.
insert
(
"i"
,
"
819
2"
,
"intermediate_size between 2 gemms of FFN"
)
.
insert
(
"k"
,
"
2
"
,
"topk"
)
.
insert
(
"h"
,
"
3
2"
,
"hidden_size of this model"
)
.
insert
(
"i"
,
"
3
2"
,
"intermediate_size between 2 gemms of FFN"
)
.
insert
(
"stride"
,
"-1"
,
"stride per row, if -1 then equal to hidden_size"
)
.
insert
(
"bm"
,
"32"
,
"blocking factor for sorted tokens"
)
.
insert
(
"tp"
,
"
8
"
,
"tensor parallel size"
)
.
insert
(
"tp"
,
"
1
"
,
"tensor parallel size"
)
.
insert
(
"v"
,
"1"
,
"cpu validation or not"
)
.
insert
(
"kname"
,
"1"
,
"print kernel name or not"
)
.
insert
(
"prec_i"
,
"bf16"
,
"input precision"
)
...
...
@@ -237,7 +237,7 @@ bool run(const ck_tile::ArgParser& arg_parser)
{
topid_unique_gen
<
IndexDataType
>
(
topk_ids_host
.
mData
,
tokens
,
topk
,
experts
,
11913
);
}
ck_tile
::
reference_moe_sorting
<
TopkWeightDataType
,
IndexDataType
>
(
topk_ids_host
,
topk_weight_host
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment