vae-decoder-onnx-fp32.log 32.3 KB
Newer Older
sunzhq2's avatar
init  
sunzhq2 committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: vae-decoder-onnx-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: fake_dataset
INFO:PerfEngine:Start to compile the model...
2024-11-13 16:49:36.004666935 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:49:36.004685902 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:49:40.971856424 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971889400 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971909342 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971954815 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971968282 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971981624 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971993351 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972006663 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972017837 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972030535 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972040996 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972066390 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972075951 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972086154 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972095979 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972107985 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972119795 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972136645 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972148083 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972161282 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972171842 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972183052 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972193217 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972211054 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972222647 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972235663 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972245696 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972255707 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972265268 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972276519 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
2024-11-13 16:49:41.441482527 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:49:41.441497193 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:49:41.930850391 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930885030 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930904787 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930942707 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930954161 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930967499 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930978987 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930990902 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931003087 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931015077 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931028041 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931053157 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931064168 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931074160 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931084046 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931094698 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931104812 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931122497 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931132287 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931145698 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931155830 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931166811 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931177168 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931194424 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931204493 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931219046 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931230482 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931241363 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931251511 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931263572 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 4, QPS: 26, Avg Latency:150.75, Tail Latency:152.65
2024-11-13 16:50:02.468503584 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:50:02.468518970 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:50:02.946045400 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946076228 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946093162 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946128849 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946140256 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946151874 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946163350 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946175829 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946187042 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946198743 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946210104 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946237843 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946248847 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946259523 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946268539 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946278193 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946287770 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946305171 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946314586 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946327956 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946337464 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946347405 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946355941 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946371480 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946381409 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946393566 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946402462 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946411952 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946421870 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946433606 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 8, QPS: 26, Avg Latency:297.52, Tail Latency:299.82
2024-11-13 16:50:42.075327817 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:50:42.075342142 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:50:42.551250958 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551282130 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551301457 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551337911 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551349816 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551361834 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551374154 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551386303 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551396495 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551407953 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551418837 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551444188 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551454417 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551464446 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551474311 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551484116 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551494686 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551512765 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551523512 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551536881 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551547525 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551558181 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551568814 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551585527 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551595671 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551606255 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551615057 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551623827 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551631899 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551640506 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 16, QPS: 25, Avg Latency:616.06, Tail Latency:618.15
2024-11-13 16:52:03.159653741 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:52:03.159669235 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:52:03.653566788 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653597010 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653614238 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653650530 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653663770 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653676318 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653685843 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653697473 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653708188 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653720238 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653729901 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653755391 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653765969 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653775027 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653782986 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653791005 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653800425 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653816376 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653825771 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653838314 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653847770 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653859110 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653868125 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653890068 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653900584 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653911796 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653921980 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653932757 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653941503 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653952407 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 24, QPS: 25, Avg Latency:930.45, Tail Latency:932.79
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/vae-decoder-onnx-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/vae-decoder-onnx-fp32/VAE-DECODER-ONNX-FP32-TO-FP32.JSON.pdf ]