I1023 02:23:35.217113 4724 params.h:114] Reading onnx model 2023-10-23 02:23:36.156021162 [W:onnxruntime:, session_state.cc:1030 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2023-10-23 02:23:36.156074381 [W:onnxruntime:, session_state.cc:1032 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. 2023-10-23 02:23:40.334596254 [W:onnxruntime:, session_state.cc:1030 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2023-10-23 02:23:40.334637713 [W:onnxruntime:, session_state.cc:1032 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. I1023 02:23:40.419196 4724 onnx_asr_model.cc:126] Onnx Model Info: I1023 02:23:40.419270 4724 onnx_asr_model.cc:127] encoder_output_size 512 I1023 02:23:40.419274 4724 onnx_asr_model.cc:128] num_blocks 12 I1023 02:23:40.419277 4724 onnx_asr_model.cc:129] head 8 I1023 02:23:40.419281 4724 onnx_asr_model.cc:130] cnn_module_kernel 15 I1023 02:23:40.419283 4724 onnx_asr_model.cc:131] subsampling_rate 4 I1023 02:23:40.419286 4724 onnx_asr_model.cc:132] right_context 6 I1023 02:23:40.419289 4724 onnx_asr_model.cc:133] sos 5537 I1023 02:23:40.419291 4724 onnx_asr_model.cc:134] eos 5537 I1023 02:23:40.419294 4724 onnx_asr_model.cc:135] is bidirectional decoder 1 I1023 02:23:40.419306 4724 onnx_asr_model.cc:136] chunk_size 16 I1023 02:23:40.419309 4724 onnx_asr_model.cc:137] num_left_chunks -1 I1023 02:23:40.419312 4724 onnx_asr_model.cc:140] Onnx Encoder: I1023 02:23:40.419337 4724 onnx_asr_model.cc:44] Input 0 : name=chunk type=1 dims=1 -1 80 I1023 02:23:40.419354 4724 onnx_asr_model.cc:44] Input 1 : name=offset type=7 dims= I1023 02:23:40.419364 4724 onnx_asr_model.cc:44] Input 2 : name=att_cache type=1 dims=12 8 -1 128 I1023 02:23:40.419373 4724 onnx_asr_model.cc:44] Input 3 : name=cnn_cache type=1 dims=12 1 512 14 I1023 02:23:40.419382 4724 onnx_asr_model.cc:65] Output 0 : name=output type=1 dims=-1 -1 512 I1023 02:23:40.419390 4724 onnx_asr_model.cc:65] Output 1 : name=r_att_cache type=1 dims=12 8 -1 128 I1023 02:23:40.419397 4724 onnx_asr_model.cc:65] Output 2 : name=r_cnn_cache type=1 dims=12 1 512 -1 I1023 02:23:40.419401 4724 onnx_asr_model.cc:142] Onnx CTC: I1023 02:23:40.419409 4724 onnx_asr_model.cc:146] Onnx Rescore: I1023 02:23:40.419420 4724 params.h:124] Reading unit table ./Resource/units.txt I1023 02:23:40.464612 4740 decoder_main.cc:40] num frames 307 I1023 02:23:40.465137 4740 asr_decoder.cc:84] Required 67 get 67 I1023 02:23:40.574081 4740 onnx_asr_model.cc:299] testFunc1004: I1023 02:23:40.596107 4740 asr_decoder.cc:84] Required 64 get 64 I1023 02:23:40.618441 4740 onnx_asr_model.cc:299] testFunc1004: I1023 02:23:40.631315 4740 asr_decoder.cc:179] Partial CTC result 脚踝河 I1023 02:23:40.631347 4740 decoder_main.cc:63] Partial result: 脚踝河 I1023 02:23:40.631395 4740 asr_decoder.cc:84] Required 64 get 64 I1023 02:23:40.653893 4740 onnx_asr_model.cc:299] testFunc1004: I1023 02:23:40.667107 4740 asr_decoder.cc:179] Partial CTC result 脚踝河小腿的 I1023 02:23:40.667135 4740 decoder_main.cc:63] Partial result: 脚踝河小腿的 I1023 02:23:40.667176 4740 asr_decoder.cc:84] Required 64 get 64 I1023 02:23:40.689602 4740 onnx_asr_model.cc:299] testFunc1004: I1023 02:23:40.703166 4740 asr_decoder.cc:179] Partial CTC result 脚踝河小腿的能力变弱 I1023 02:23:40.703200 4740 decoder_main.cc:63] Partial result: 脚踝河小腿的能力变弱 I1023 02:23:40.703249 4740 asr_decoder.cc:84] Required 64 get 48 I1023 02:23:40.742993 4740 onnx_asr_model.cc:299] testFunc1004: I1023 02:23:40.753594 4740 asr_decoder.cc:179] Partial CTC result 脚踝河小腿的能力变弱 I1023 02:23:40.754094 4740 asr_decoder.cc:179] Partial CTC result 脚踝河小腿的能力变弱 I1023 02:23:40.792695 4740 asr_decoder.cc:64] Rescoring cost latency: 39ms. I1023 02:23:40.792733 4740 decoder_main.cc:63] Partial result: 脚踝和小腿的能力变弱 I1023 02:23:40.792738 4740 decoder_main.cc:96] test Final result: 脚踝和小腿的能力变弱 I1023 02:23:40.792752 4740 decoder_main.cc:97] Decoded 3091ms audio taken 325ms. I1023 02:23:40.792986 4724 decoder_main.cc:172] Total: decoded 3091ms audio taken 325ms. I1023 02:23:40.793023 4724 decoder_main.cc:174] RTF: 0.1051 HIP Warning: kernel (_ZN11onnxruntime4rocm37_BinaryElementWiseRhsPerChannelBatchNIfffNS0_6OP_SubIfffEELi512ELi2EEEvPKT0_PKT1_NS0_11fast_divmodESA_PT_T2_i) launch (512) threads out of range (256), add __launch_bounds__ to kernel define or use --gpu-max-threads-per-block recompile program !