Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
composable_kernel
Commits
d2000114
Commit
d2000114
authored
Oct 31, 2022
by
Qianfeng Zhang
Browse files
Add batchnorm backward to README
parent
d5728dd3
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
25 additions
and
0 deletions
+25
-0
example/34_batchnorm/README.md
example/34_batchnorm/README.md
+25
-0
No files found.
example/34_batchnorm/README.md
View file @
d2000114
...
...
@@ -53,4 +53,29 @@ Start running 10 times...
Perf: 1.28235 ms, 523.329 GB/s
```
## Run ```batchnorm backward nhwc```
```
bash
# -D <xxx> : input 4-d tensor lengths
# -v <x> : verification (0=no, 1=yes)
Arg1: data
type
(
0: fp16, 1: fp32, 3: int8, 5: bp16, 6: fp64
)
Arg2
--
1/0 to indicate whether to use saved mean and invVariance
Arg3
--
init method used
for
dy and bnScale
(
0
=
no init,
1
=
single integer value,
2
=
scope integer value,
3
=
decimal value
)
Arg4
--
time
kernel
(
0
=
no,
1
=
yes
)
Arg5: use multi-block welford
(
0
=
n0,
1
=
yes
)
./bin/example_batchnorm_backward
-D
128,16,3,1024
-v
1 0 0 3 1 1
```
Result
```
./bin/example_batchnorm_backward -D 128,16,3,1024 -v 1 0 0 3 1 1
launch_and_time_kernel: grid_dim {6144, 1, 1}, block_dim {256, 1, 1}
Warm up 1 time
Start running 10 times...
launch_and_time_kernel: grid_dim {6144, 1, 1}, block_dim {256, 1, 1}
Warm up 1 time
Start running 10 times...
launch_and_time_kernel: grid_dim {6144, 1, 1}, block_dim {256, 1, 1}
Warm up 1 time
Start running 10 times...
Perf: 0.411026 ms, 91.8702 GB/s
```
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment