vae-encoder-onnx-fp32.log 24.6 KB
Newer Older
sunzhq2's avatar
init  
sunzhq2 committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: vae-encoder-onnx-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: fake_dataset
INFO:PerfEngine:Start to compile the model...
2024-11-13 16:46:54.191740885 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:46:54.191759087 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:46:59.150361604 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150391639 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150405303 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150416984 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150434631 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150445757 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150458965 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150470802 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150487984 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150499555 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150514117 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150523824 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150537877 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150547716 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150558286 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150568119 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150580297 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150591482 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150607008 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150651834 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150662854 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150674555 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
2024-11-13 16:46:59.580210398 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:46:59.580224783 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:47:00.044952484 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.044983008 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.044996134 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045008901 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045027540 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045040134 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045055334 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045066731 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045083819 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045096304 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045111111 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045121100 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045135177 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045145100 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045156377 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045165963 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045175649 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045186804 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045203440 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045236585 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045247040 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045257947 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 4, QPS: 55, Avg Latency:72.39, Tail Latency:74.4
2024-11-13 16:47:10.455819780 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:47:10.455834299 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:47:10.917825142 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917854250 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917866318 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917880951 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917899164 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917909723 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917922919 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917935015 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917951953 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917962624 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917975429 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917985730 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917998993 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918007165 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918018157 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918027202 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918038331 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918047943 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918063105 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918095722 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918105524 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918115016 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 8, QPS: 56, Avg Latency:142.6, Tail Latency:144.75
2024-11-13 16:47:29.966399973 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:47:29.966415034 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:47:30.429985531 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430014162 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430026571 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430036430 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430052250 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430063533 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430076562 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430087163 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430102667 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430113526 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430128017 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430139353 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430154673 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430163795 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430173602 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430182317 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430192331 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430201858 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430217286 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430247703 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430258509 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430267612 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 16, QPS: 54, Avg Latency:293.01, Tail Latency:295.03
2024-11-13 16:48:09.048249394 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:48:09.048264926 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:48:09.513201066 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513230691 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513243084 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513252307 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513269287 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513280975 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513294247 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513304995 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513321387 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513332448 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513345003 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513354399 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513367832 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513376162 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513386325 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513394779 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513404904 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513415758 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513432502 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513466045 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513477124 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513487226 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 24, QPS: 53, Avg Latency:444.56, Tail Latency:446.61
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/vae-encoder-onnx-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/vae-encoder-onnx-fp32/VAE-ENCODER-ONNX-FP32-TO-FP32.JSON.pdf ]