Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
composable_kernel
Commits
5d7ab929
Commit
5d7ab929
authored
Sep 16, 2022
by
Jing Zhang
Browse files
add an example of large c
parent
efd1d257
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
18 additions
and
16 deletions
+18
-16
example/25_gemm_bias_e_permute/gemm_bias_e_permute_g1m2n3k1_xdl_fp16.cpp
..._bias_e_permute/gemm_bias_e_permute_g1m2n3k1_xdl_fp16.cpp
+18
-16
No files found.
example/25_gemm_bias_e_permute/gemm_bias_e_permute_g1m2n3k1_xdl_fp16.cpp
View file @
5d7ab929
...
@@ -202,29 +202,31 @@ int main(int argc, char* argv[])
...
@@ -202,29 +202,31 @@ int main(int argc, char* argv[])
int
init_method
=
1
;
int
init_method
=
1
;
bool
time_kernel
=
false
;
bool
time_kernel
=
false
;
ck
::
index_t
G
0
=
1
;
ck
::
index_t
G
=
3
;
ck
::
index_t
M0
=
4
;
ck
::
index_t
M0
=
128
;
// batch
ck
::
index_t
M1
=
256
;
ck
::
index_t
M1
=
4096
;
// seq
ck
::
index_t
N0
=
4
;
ck
::
index_t
N0
=
1
;
ck
::
index_t
N1
=
1
6
;
ck
::
index_t
N1
=
1
2
;
// num_heads
ck
::
index_t
N2
=
32
;
ck
::
index_t
N2
=
64
;
// head_dims
ck
::
index_t
K0
=
256
;
ck
::
index_t
K0
=
768
;
// A[M0, M1, M2, K0]
// A[G, M0, M1, K0]
std
::
vector
<
ck
::
index_t
>
a_gs_ms_ks_lengths
{
G0
,
M0
,
M1
,
K0
};
std
::
vector
<
ck
::
index_t
>
a_gs_ms_ks_lengths
{
G
,
M0
,
M1
,
K0
};
std
::
vector
<
ck
::
index_t
>
a_gs_ms_ks_strides
{
M0
*
M1
*
K0
,
M1
*
K0
,
K0
,
1
};
std
::
vector
<
ck
::
index_t
>
a_gs_ms_ks_strides
{
0
,
M1
*
K0
,
K0
,
1
};
// B[N0, N1, K0]
std
::
vector
<
ck
::
index_t
>
b_gs_ns_ks_lengths
{
G0
,
N0
,
N1
,
N2
,
K0
};
// B[G, N0, N1, N2, K0]
std
::
vector
<
ck
::
index_t
>
b_gs_ns_ks_lengths
{
G
,
N0
,
N1
,
N2
,
K0
};
std
::
vector
<
ck
::
index_t
>
b_gs_ns_ks_strides
{
N0
*
N1
*
N2
*
K0
,
N1
*
N2
*
K0
,
N2
*
K0
,
K0
,
1
};
std
::
vector
<
ck
::
index_t
>
b_gs_ns_ks_strides
{
N0
*
N1
*
N2
*
K0
,
N1
*
N2
*
K0
,
N2
*
K0
,
K0
,
1
};
// D[N0, M0, N1, M1, N2]
// D[
G,
N0, M0, N1, M1, N2]
std
::
vector
<
ck
::
index_t
>
d_gs_ms_ns_lengths
{
G
0
,
M0
,
M1
,
N0
,
N1
,
N2
};
std
::
vector
<
ck
::
index_t
>
d_gs_ms_ns_lengths
{
G
,
M0
,
M1
,
N0
,
N1
,
N2
};
std
::
vector
<
ck
::
index_t
>
d_gs_ms_ns_strides
{
N0
*
N1
*
N2
,
0
,
0
,
N1
*
N2
,
N2
,
1
};
std
::
vector
<
ck
::
index_t
>
d_gs_ms_ns_strides
{
N0
*
N1
*
N2
,
0
,
0
,
N1
*
N2
,
N2
,
1
};
// E[N0, M0, N1, M1, N2]
std
::
vector
<
ck
::
index_t
>
e_gs_ms_ns_lengths
{
G0
,
M0
,
M1
,
N0
,
N1
,
N2
};
// E[G, N0, M0, N1, M1, N2]
std
::
vector
<
ck
::
index_t
>
e_gs_ms_ns_lengths
{
G
,
M0
,
M1
,
N0
,
N1
,
N2
};
std
::
vector
<
ck
::
index_t
>
e_gs_ms_ns_strides
{
std
::
vector
<
ck
::
index_t
>
e_gs_ms_ns_strides
{
M0
*
M1
*
N0
*
N1
*
N2
,
N1
*
M1
*
N2
,
N2
,
M0
*
N1
*
M1
*
N2
,
M1
*
N2
,
1
};
M0
*
M1
*
N0
*
N1
*
N2
,
N1
*
M1
*
N2
,
N2
,
M0
*
N1
*
M1
*
N2
,
M1
*
N2
,
1
};
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment