[2024/07/27 11:19:01] ppocr INFO: Architecture : [2024/07/27 11:19:01] ppocr INFO: Backbone : [2024/07/27 11:19:01] ppocr INFO: model_name : large [2024/07/27 11:19:01] ppocr INFO: name : MobileNetV3 [2024/07/27 11:19:01] ppocr INFO: scale : 0.5 [2024/07/27 11:19:01] ppocr INFO: Head : [2024/07/27 11:19:01] ppocr INFO: k : 50 [2024/07/27 11:19:01] ppocr INFO: name : DBHead [2024/07/27 11:19:01] ppocr INFO: Neck : [2024/07/27 11:19:01] ppocr INFO: name : DBFPN [2024/07/27 11:19:01] ppocr INFO: out_channels : 256 [2024/07/27 11:19:01] ppocr INFO: Transform : None [2024/07/27 11:19:01] ppocr INFO: algorithm : DB [2024/07/27 11:19:01] ppocr INFO: model_type : det [2024/07/27 11:19:01] ppocr INFO: Eval : [2024/07/27 11:19:01] ppocr INFO: dataset : [2024/07/27 11:19:01] ppocr INFO: data_dir : /datasets/icdar2015/text_localization/ [2024/07/27 11:19:01] ppocr INFO: label_file_list : ['/datasets/icdar2015/text_localization/test_icdar2015_label.txt'] [2024/07/27 11:19:01] ppocr INFO: name : SimpleDataSet [2024/07/27 11:19:01] ppocr INFO: transforms : [2024/07/27 11:19:01] ppocr INFO: DecodeImage : [2024/07/27 11:19:01] ppocr INFO: channel_first : False [2024/07/27 11:19:01] ppocr INFO: img_mode : BGR [2024/07/27 11:19:01] ppocr INFO: DetLabelEncode : None [2024/07/27 11:19:01] ppocr INFO: DetResizeForTest : [2024/07/27 11:19:01] ppocr INFO: image_shape : [736, 1280] [2024/07/27 11:19:01] ppocr INFO: NormalizeImage : [2024/07/27 11:19:01] ppocr INFO: mean : [0.485, 0.456, 0.406] [2024/07/27 11:19:01] ppocr INFO: order : hwc [2024/07/27 11:19:01] ppocr INFO: scale : 1./255. [2024/07/27 11:19:01] ppocr INFO: std : [0.229, 0.224, 0.225] [2024/07/27 11:19:01] ppocr INFO: ToCHWImage : None [2024/07/27 11:19:01] ppocr INFO: KeepKeys : [2024/07/27 11:19:01] ppocr INFO: keep_keys : ['image', 'shape', 'polys', 'ignore_tags'] [2024/07/27 11:19:01] ppocr INFO: loader : [2024/07/27 11:19:01] ppocr INFO: batch_size_per_card : 1 [2024/07/27 11:19:01] ppocr INFO: drop_last : False [2024/07/27 11:19:01] ppocr INFO: num_workers : 0 [2024/07/27 11:19:01] ppocr INFO: shuffle : False [2024/07/27 11:19:01] ppocr INFO: use_shared_memory : False [2024/07/27 11:19:01] ppocr INFO: Global : [2024/07/27 11:19:01] ppocr INFO: cal_metric_during_train : False [2024/07/27 11:19:01] ppocr INFO: checkpoints : None [2024/07/27 11:19:01] ppocr INFO: distributed : True [2024/07/27 11:19:01] ppocr INFO: epoch_num : 1500 [2024/07/27 11:19:01] ppocr INFO: eval_batch_step : [0, 60] [2024/07/27 11:19:01] ppocr INFO: infer_img : doc/imgs_en/img_10.jpg [2024/07/27 11:19:01] ppocr INFO: log_smooth_window : 20 [2024/07/27 11:19:01] ppocr INFO: pretrained_model : ./pretrain_models/MobileNetV3_large_x0_5_pretrained [2024/07/27 11:19:01] ppocr INFO: print_batch_step : 10 [2024/07/27 11:19:01] ppocr INFO: save_epoch_step : 1200 [2024/07/27 11:19:01] ppocr INFO: save_inference_dir : None [2024/07/27 11:19:01] ppocr INFO: save_model_dir : ./output/db_mv3/ [2024/07/27 11:19:01] ppocr INFO: save_res_path : ./output/det_db/predicts_db.txt [2024/07/27 11:19:01] ppocr INFO: use_gpu : True [2024/07/27 11:19:01] ppocr INFO: use_visualdl : False [2024/07/27 11:19:01] ppocr INFO: use_xpu : False [2024/07/27 11:19:01] ppocr INFO: Loss : [2024/07/27 11:19:01] ppocr INFO: alpha : 5 [2024/07/27 11:19:01] ppocr INFO: balance_loss : True [2024/07/27 11:19:01] ppocr INFO: beta : 10 [2024/07/27 11:19:01] ppocr INFO: main_loss_type : DiceLoss [2024/07/27 11:19:01] ppocr INFO: name : DBLoss [2024/07/27 11:19:01] ppocr INFO: ohem_ratio : 3 [2024/07/27 11:19:01] ppocr INFO: Metric : [2024/07/27 11:19:01] ppocr INFO: main_indicator : hmean [2024/07/27 11:19:01] ppocr INFO: name : DetMetric [2024/07/27 11:19:01] ppocr INFO: Optimizer : [2024/07/27 11:19:01] ppocr INFO: beta1 : 0.9 [2024/07/27 11:19:01] ppocr INFO: beta2 : 0.999 [2024/07/27 11:19:01] ppocr INFO: lr : [2024/07/27 11:19:01] ppocr INFO: learning_rate : 0.001 [2024/07/27 11:19:01] ppocr INFO: name : Adam [2024/07/27 11:19:01] ppocr INFO: regularizer : [2024/07/27 11:19:01] ppocr INFO: factor : 0 [2024/07/27 11:19:01] ppocr INFO: name : L2 [2024/07/27 11:19:01] ppocr INFO: PostProcess : [2024/07/27 11:19:01] ppocr INFO: box_thresh : 0.6 [2024/07/27 11:19:01] ppocr INFO: max_candidates : 1000 [2024/07/27 11:19:01] ppocr INFO: name : DBPostProcess [2024/07/27 11:19:01] ppocr INFO: thresh : 0.3 [2024/07/27 11:19:01] ppocr INFO: unclip_ratio : 1.5 [2024/07/27 11:19:01] ppocr INFO: Train : [2024/07/27 11:19:01] ppocr INFO: dataset : [2024/07/27 11:19:01] ppocr INFO: data_dir : /datasets/icdar2015/text_localization/ [2024/07/27 11:19:01] ppocr INFO: label_file_list : ['/datasets/icdar2015/text_localization/train_icdar2015_label.txt'] [2024/07/27 11:19:01] ppocr INFO: name : SimpleDataSet [2024/07/27 11:19:01] ppocr INFO: ratio_list : [1.0] [2024/07/27 11:19:01] ppocr INFO: transforms : [2024/07/27 11:19:01] ppocr INFO: DecodeImage : [2024/07/27 11:19:01] ppocr INFO: channel_first : False [2024/07/27 11:19:01] ppocr INFO: img_mode : BGR [2024/07/27 11:19:01] ppocr INFO: DetLabelEncode : None [2024/07/27 11:19:01] ppocr INFO: IaaAugment : [2024/07/27 11:19:01] ppocr INFO: augmenter_args : [2024/07/27 11:19:01] ppocr INFO: args : [2024/07/27 11:19:01] ppocr INFO: p : 0.5 [2024/07/27 11:19:01] ppocr INFO: type : Fliplr [2024/07/27 11:19:01] ppocr INFO: args : [2024/07/27 11:19:01] ppocr INFO: rotate : [-10, 10] [2024/07/27 11:19:01] ppocr INFO: type : Affine [2024/07/27 11:19:01] ppocr INFO: args : [2024/07/27 11:19:01] ppocr INFO: size : [0.5, 3] [2024/07/27 11:19:01] ppocr INFO: type : Resize [2024/07/27 11:19:01] ppocr INFO: EastRandomCropData : [2024/07/27 11:19:01] ppocr INFO: keep_ratio : True [2024/07/27 11:19:01] ppocr INFO: max_tries : 50 [2024/07/27 11:19:01] ppocr INFO: size : [640, 640] [2024/07/27 11:19:01] ppocr INFO: MakeBorderMap : [2024/07/27 11:19:01] ppocr INFO: shrink_ratio : 0.4 [2024/07/27 11:19:01] ppocr INFO: thresh_max : 0.7 [2024/07/27 11:19:01] ppocr INFO: thresh_min : 0.3 [2024/07/27 11:19:01] ppocr INFO: MakeShrinkMap : [2024/07/27 11:19:01] ppocr INFO: min_text_size : 8 [2024/07/27 11:19:01] ppocr INFO: shrink_ratio : 0.4 [2024/07/27 11:19:01] ppocr INFO: NormalizeImage : [2024/07/27 11:19:01] ppocr INFO: mean : [0.485, 0.456, 0.406] [2024/07/27 11:19:01] ppocr INFO: order : hwc [2024/07/27 11:19:01] ppocr INFO: scale : 1./255. [2024/07/27 11:19:01] ppocr INFO: std : [0.229, 0.224, 0.225] [2024/07/27 11:19:01] ppocr INFO: ToCHWImage : None [2024/07/27 11:19:01] ppocr INFO: KeepKeys : [2024/07/27 11:19:01] ppocr INFO: keep_keys : ['image', 'threshold_map', 'threshold_mask', 'shrink_map', 'shrink_mask'] [2024/07/27 11:19:01] ppocr INFO: loader : [2024/07/27 11:19:01] ppocr INFO: batch_size_per_card : 48 [2024/07/27 11:19:01] ppocr INFO: drop_last : False [2024/07/27 11:19:01] ppocr INFO: num_workers : 8 [2024/07/27 11:19:01] ppocr INFO: shuffle : True [2024/07/27 11:19:01] ppocr INFO: use_shared_memory : False [2024/07/27 11:19:01] ppocr INFO: profiler_options : None [2024/07/27 11:19:01] ppocr INFO: train with paddle 2.5.2 and device Place(gpu:0) ======================= Modified FLAGS detected ======================= FLAGS(name='FLAGS_selected_gpus', current_value='0', default_value='') FLAGS(name='FLAGS_cudnn_batchnorm_spatial_persistent', current_value=True, default_value=False) ======================================================================= I0727 11:19:01.153348 2855 tcp_utils.cc:181] The server starts to listen on IP_ANY:52742 I0727 11:19:01.153559 2855 tcp_utils.cc:130] Successfully connected to 127.0.0.1:52742 I0727 11:19:04.271463 2855 process_group_nccl.cc:120] ProcessGroupNCCL pg_timeout_ 1800000 [2024/07/27 11:19:04] ppocr INFO: Initialize indexs of datasets:['/datasets/icdar2015/text_localization/train_icdar2015_label.txt'] [2024/07/27 11:19:04] ppocr INFO: Initialize indexs of datasets:['/datasets/icdar2015/text_localization/test_icdar2015_label.txt'] W0727 11:19:04.289928 2855 gpu_resources.cc:119] Please NOTE: device: 0, GPU Compute Capability: 90.2, Driver API Version: 50724.2, Runtime API Version: 50724.2 [2024/07/27 11:19:05] ppocr INFO: load pretrain successful from ./pretrain_models/MobileNetV3_large_x0_5_pretrained [2024/07/27 11:19:05] ppocr INFO: train dataloader has 3 iters [2024/07/27 11:19:05] ppocr INFO: valid dataloader has 500 iters [2024/07/27 11:19:05] ppocr INFO: During the training process, after the 0th iteration, an evaluation is run every 60 iterations [2024/07/27 11:20:25] ppocr INFO: epoch: [1/1500], global_step: 3, lr: 0.001000, loss: 9.480772, loss_shrink_maps: 4.930692, loss_threshold_maps: 3.563909, loss_binary_maps: 0.986170, avg_reader_cost: 13.32391 s, avg_batch_cost: 19.60355 s, avg_samples: 12.5, ips: 0.63764 samples/s, eta: 3 days, 9:37:37 [2024/07/27 11:20:26] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:20:37] ppocr INFO: epoch: [2/1500], global_step: 6, lr: 0.001000, loss: 8.544098, loss_shrink_maps: 4.935206, loss_threshold_maps: 2.603798, loss_binary_maps: 0.988400, avg_reader_cost: 2.95120 s, avg_batch_cost: 3.18849 s, avg_samples: 12.5, ips: 3.92035 samples/s, eta: 1 day, 23:25:12 [2024/07/27 11:20:38] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:20:49] ppocr INFO: epoch: [3/1500], global_step: 9, lr: 0.001000, loss: 7.708382, loss_shrink_maps: 4.930692, loss_threshold_maps: 1.779346, loss_binary_maps: 0.987835, avg_reader_cost: 2.90512 s, avg_batch_cost: 3.15215 s, avg_samples: 12.5, ips: 3.96555 samples/s, eta: 1 day, 11:57:41 [2024/07/27 11:20:50] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:20:59] ppocr INFO: epoch: [4/1500], global_step: 10, lr: 0.001000, loss: 7.494616, loss_shrink_maps: 4.931758, loss_threshold_maps: 1.572014, loss_binary_maps: 0.987142, avg_reader_cost: 0.78054 s, avg_batch_cost: 1.00046 s, avg_samples: 4.8, ips: 4.79781 samples/s, eta: 1 day, 9:36:21 [2024/07/27 11:21:01] ppocr INFO: epoch: [4/1500], global_step: 12, lr: 0.001000, loss: 7.228681, loss_shrink_maps: 4.931758, loss_threshold_maps: 1.315077, loss_binary_maps: 0.986440, avg_reader_cost: 2.09298 s, avg_batch_cost: 2.23981 s, avg_samples: 7.7, ips: 3.43778 samples/s, eta: 1 day, 6:19:09 [2024/07/27 11:21:02] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:21:13] ppocr INFO: epoch: [5/1500], global_step: 15, lr: 0.001000, loss: 7.112224, loss_shrink_maps: 4.930692, loss_threshold_maps: 1.184255, loss_binary_maps: 0.986170, avg_reader_cost: 2.83620 s, avg_batch_cost: 3.17688 s, avg_samples: 12.5, ips: 3.93468 samples/s, eta: 1 day, 2:52:40 [2024/07/27 11:21:14] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:21:25] ppocr INFO: epoch: [6/1500], global_step: 18, lr: 0.001000, loss: 7.093850, loss_shrink_maps: 4.930370, loss_threshold_maps: 1.176808, loss_binary_maps: 0.985607, avg_reader_cost: 2.90469 s, avg_batch_cost: 3.14202 s, avg_samples: 12.5, ips: 3.97833 samples/s, eta: 1 day, 0:33:23 [2024/07/27 11:21:26] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:21:36] ppocr INFO: epoch: [7/1500], global_step: 20, lr: 0.001000, loss: 7.082152, loss_shrink_maps: 4.929456, loss_threshold_maps: 1.166440, loss_binary_maps: 0.985553, avg_reader_cost: 1.78845 s, avg_batch_cost: 2.07187 s, avg_samples: 9.6, ips: 4.63350 samples/s, eta: 23:22:48 [2024/07/27 11:21:37] ppocr INFO: epoch: [7/1500], global_step: 21, lr: 0.001000, loss: 7.067038, loss_shrink_maps: 4.929456, loss_threshold_maps: 1.150968, loss_binary_maps: 0.985553, avg_reader_cost: 1.08215 s, avg_batch_cost: 1.13755 s, avg_samples: 2.9, ips: 2.54934 samples/s, eta: 22:56:08 [2024/07/27 11:21:38] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:21:48] ppocr INFO: epoch: [8/1500], global_step: 24, lr: 0.001000, loss: 7.042310, loss_shrink_maps: 4.925900, loss_threshold_maps: 1.135616, loss_binary_maps: 0.983872, avg_reader_cost: 2.74143 s, avg_batch_cost: 3.07715 s, avg_samples: 12.5, ips: 4.06220 samples/s, eta: 21:38:58 [2024/07/27 11:21:49] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:22:00] ppocr INFO: epoch: [9/1500], global_step: 27, lr: 0.001000, loss: 6.963614, loss_shrink_maps: 4.904892, loss_threshold_maps: 1.096257, loss_binary_maps: 0.979010, avg_reader_cost: 2.87324 s, avg_batch_cost: 3.24731 s, avg_samples: 12.5, ips: 3.84934 samples/s, eta: 20:43:31 [2024/07/27 11:22:01] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:22:12] ppocr INFO: epoch: [10/1500], global_step: 30, lr: 0.001000, loss: 6.922710, loss_shrink_maps: 4.890026, loss_threshold_maps: 1.045500, loss_binary_maps: 0.974394, avg_reader_cost: 2.89083 s, avg_batch_cost: 3.13008 s, avg_samples: 12.5, ips: 3.99350 samples/s, eta: 19:56:09 [2024/07/27 11:22:13] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:22:24] ppocr INFO: epoch: [11/1500], global_step: 33, lr: 0.001000, loss: 6.859891, loss_shrink_maps: 4.888492, loss_threshold_maps: 1.009600, loss_binary_maps: 0.973823, avg_reader_cost: 2.75596 s, avg_batch_cost: 3.10461 s, avg_samples: 12.5, ips: 4.02628 samples/s, eta: 19:16:43 [2024/07/27 11:22:25] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:22:36] ppocr INFO: epoch: [12/1500], global_step: 36, lr: 0.001000, loss: 6.831796, loss_shrink_maps: 4.880192, loss_threshold_maps: 0.993817, loss_binary_maps: 0.972217, avg_reader_cost: 2.90053 s, avg_batch_cost: 3.25971 s, avg_samples: 12.5, ips: 3.83470 samples/s, eta: 18:46:59 [2024/07/27 11:22:37] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:22:48] ppocr INFO: epoch: [13/1500], global_step: 39, lr: 0.001000, loss: 6.818047, loss_shrink_maps: 4.862352, loss_threshold_maps: 0.956775, loss_binary_maps: 0.968630, avg_reader_cost: 2.75273 s, avg_batch_cost: 3.04437 s, avg_samples: 12.5, ips: 4.10594 samples/s, eta: 18:17:38 [2024/07/27 11:22:49] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:22:59] ppocr INFO: epoch: [14/1500], global_step: 40, lr: 0.001000, loss: 6.809054, loss_shrink_maps: 4.859376, loss_threshold_maps: 0.955596, loss_binary_maps: 0.967310, avg_reader_cost: 0.91054 s, avg_batch_cost: 1.00106 s, avg_samples: 4.8, ips: 4.79493 samples/s, eta: 18:08:33 [2024/07/27 11:23:00] ppocr INFO: epoch: [14/1500], global_step: 42, lr: 0.001000, loss: 6.778828, loss_shrink_maps: 4.852133, loss_threshold_maps: 0.944726, loss_binary_maps: 0.956009, avg_reader_cost: 2.09526 s, avg_batch_cost: 2.24368 s, avg_samples: 7.7, ips: 3.43186 samples/s, eta: 17:55:56 [2024/07/27 11:23:01] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:23:12] ppocr INFO: epoch: [15/1500], global_step: 45, lr: 0.001000, loss: 6.698614, loss_shrink_maps: 4.836128, loss_threshold_maps: 0.934905, loss_binary_maps: 0.946085, avg_reader_cost: 2.79339 s, avg_batch_cost: 3.19919 s, avg_samples: 12.5, ips: 3.90724 samples/s, eta: 17:36:19 [2024/07/27 11:23:13] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:23:24] ppocr INFO: epoch: [16/1500], global_step: 48, lr: 0.001000, loss: 6.661482, loss_shrink_maps: 4.807730, loss_threshold_maps: 0.914088, loss_binary_maps: 0.942309, avg_reader_cost: 2.78737 s, avg_batch_cost: 3.15760 s, avg_samples: 12.5, ips: 3.95870 samples/s, eta: 17:18:27 [2024/07/27 11:23:25] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:23:36] ppocr INFO: epoch: [17/1500], global_step: 50, lr: 0.001000, loss: 6.626173, loss_shrink_maps: 4.804862, loss_threshold_maps: 0.898176, loss_binary_maps: 0.934271, avg_reader_cost: 1.86880 s, avg_batch_cost: 2.05809 s, avg_samples: 9.6, ips: 4.66451 samples/s, eta: 17:06:59 [2024/07/27 11:23:36] ppocr INFO: epoch: [17/1500], global_step: 51, lr: 0.001000, loss: 6.610918, loss_shrink_maps: 4.804862, loss_threshold_maps: 0.891841, loss_binary_maps: 0.923617, avg_reader_cost: 1.07517 s, avg_batch_cost: 1.13042 s, avg_samples: 2.9, ips: 2.56542 samples/s, eta: 17:03:04 [2024/07/27 11:23:37] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:23:48] ppocr INFO: epoch: [18/1500], global_step: 54, lr: 0.001000, loss: 6.571888, loss_shrink_maps: 4.799198, loss_threshold_maps: 0.888733, loss_binary_maps: 0.911923, avg_reader_cost: 2.97674 s, avg_batch_cost: 3.30318 s, avg_samples: 12.5, ips: 3.78423 samples/s, eta: 16:50:54 [2024/07/27 11:23:49] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:24:00] ppocr INFO: epoch: [19/1500], global_step: 57, lr: 0.001000, loss: 6.543092, loss_shrink_maps: 4.794786, loss_threshold_maps: 0.876342, loss_binary_maps: 0.891371, avg_reader_cost: 2.77563 s, avg_batch_cost: 3.10389 s, avg_samples: 12.5, ips: 4.02720 samples/s, eta: 16:37:22 [2024/07/27 11:24:01] ppocr INFO: save model in ./output/db_mv3/latest [2024/07/27 11:24:12] ppocr INFO: epoch: [20/1500], global_step: 60, lr: 0.001000, loss: 6.482062, loss_shrink_maps: 4.793821, loss_threshold_maps: 0.876342, loss_binary_maps: 0.812436, avg_reader_cost: 3.00557 s, avg_batch_cost: 3.24359 s, avg_samples: 12.5, ips: 3.85375 samples/s, eta: 16:26:52 eval model:: 0%| | 0/500 [00:00(int, unsigned long*, unsigned long) ---------------------- Error Message Summary: ---------------------- FatalError: `Termination signal` is detected by the operating system. [TimeInfo: *** Aborted at 1722505391 (unix time) try "date -d @1722505391" if you are using GNU date ***] [SignalInfo: *** SIGTERM (@0x28f) received by PID 736 (TID 0x7fbca936b740) from PID 655 ***] [2024/08/01 17:45:05] ppocr INFO: Architecture : [2024/08/01 17:45:05] ppocr INFO: Backbone : [2024/08/01 17:45:05] ppocr INFO: model_name : large [2024/08/01 17:45:05] ppocr INFO: name : MobileNetV3 [2024/08/01 17:45:05] ppocr INFO: scale : 0.5 [2024/08/01 17:45:05] ppocr INFO: Head : [2024/08/01 17:45:05] ppocr INFO: k : 50 [2024/08/01 17:45:05] ppocr INFO: name : DBHead [2024/08/01 17:45:05] ppocr INFO: Neck : [2024/08/01 17:45:05] ppocr INFO: name : DBFPN [2024/08/01 17:45:05] ppocr INFO: out_channels : 256 [2024/08/01 17:45:05] ppocr INFO: Transform : None [2024/08/01 17:45:05] ppocr INFO: algorithm : DB [2024/08/01 17:45:05] ppocr INFO: model_type : det [2024/08/01 17:45:05] ppocr INFO: Eval : [2024/08/01 17:45:05] ppocr INFO: dataset : [2024/08/01 17:45:05] ppocr INFO: data_dir : /datasets/icdar2015/text_localization/ [2024/08/01 17:45:05] ppocr INFO: label_file_list : ['/datasets/icdar2015/text_localization/test_icdar2015_label.txt'] [2024/08/01 17:45:05] ppocr INFO: name : SimpleDataSet [2024/08/01 17:45:05] ppocr INFO: transforms : [2024/08/01 17:45:05] ppocr INFO: DecodeImage : [2024/08/01 17:45:05] ppocr INFO: channel_first : False [2024/08/01 17:45:05] ppocr INFO: img_mode : BGR [2024/08/01 17:45:05] ppocr INFO: DetLabelEncode : None [2024/08/01 17:45:05] ppocr INFO: DetResizeForTest : [2024/08/01 17:45:05] ppocr INFO: image_shape : [736, 1280] [2024/08/01 17:45:05] ppocr INFO: NormalizeImage : [2024/08/01 17:45:05] ppocr INFO: mean : [0.485, 0.456, 0.406] [2024/08/01 17:45:05] ppocr INFO: order : hwc [2024/08/01 17:45:05] ppocr INFO: scale : 1./255. [2024/08/01 17:45:05] ppocr INFO: std : [0.229, 0.224, 0.225] [2024/08/01 17:45:05] ppocr INFO: ToCHWImage : None [2024/08/01 17:45:05] ppocr INFO: KeepKeys : [2024/08/01 17:45:05] ppocr INFO: keep_keys : ['image', 'shape', 'polys', 'ignore_tags'] [2024/08/01 17:45:05] ppocr INFO: loader : [2024/08/01 17:45:05] ppocr INFO: batch_size_per_card : 1 [2024/08/01 17:45:05] ppocr INFO: drop_last : False [2024/08/01 17:45:05] ppocr INFO: num_workers : 0 [2024/08/01 17:45:05] ppocr INFO: shuffle : False [2024/08/01 17:45:05] ppocr INFO: use_shared_memory : True [2024/08/01 17:45:05] ppocr INFO: Global : [2024/08/01 17:45:05] ppocr INFO: cal_metric_during_train : False [2024/08/01 17:45:05] ppocr INFO: checkpoints : None [2024/08/01 17:45:05] ppocr INFO: distributed : True [2024/08/01 17:45:05] ppocr INFO: epoch_num : 100 [2024/08/01 17:45:05] ppocr INFO: eval_batch_step : [0, 60] [2024/08/01 17:45:05] ppocr INFO: infer_img : doc/imgs_en/img_10.jpg [2024/08/01 17:45:05] ppocr INFO: log_smooth_window : 20 [2024/08/01 17:45:05] ppocr INFO: pretrained_model : ./pretrain_models/MobileNetV3_large_x0_5_pretrained [2024/08/01 17:45:05] ppocr INFO: print_batch_step : 10 [2024/08/01 17:45:05] ppocr INFO: save_epoch_step : 1200 [2024/08/01 17:45:05] ppocr INFO: save_inference_dir : None [2024/08/01 17:45:05] ppocr INFO: save_model_dir : ./output/db_mv3/ [2024/08/01 17:45:05] ppocr INFO: save_res_path : ./output/det_db/predicts_db.txt [2024/08/01 17:45:05] ppocr INFO: use_gpu : True [2024/08/01 17:45:05] ppocr INFO: use_visualdl : False [2024/08/01 17:45:05] ppocr INFO: use_xpu : False [2024/08/01 17:45:05] ppocr INFO: Loss : [2024/08/01 17:45:05] ppocr INFO: alpha : 5 [2024/08/01 17:45:05] ppocr INFO: balance_loss : True [2024/08/01 17:45:05] ppocr INFO: beta : 10 [2024/08/01 17:45:05] ppocr INFO: main_loss_type : DiceLoss [2024/08/01 17:45:05] ppocr INFO: name : DBLoss [2024/08/01 17:45:05] ppocr INFO: ohem_ratio : 3 [2024/08/01 17:45:05] ppocr INFO: Metric : [2024/08/01 17:45:05] ppocr INFO: main_indicator : hmean [2024/08/01 17:45:05] ppocr INFO: name : DetMetric [2024/08/01 17:45:05] ppocr INFO: Optimizer : [2024/08/01 17:45:05] ppocr INFO: beta1 : 0.9 [2024/08/01 17:45:05] ppocr INFO: beta2 : 0.999 [2024/08/01 17:45:05] ppocr INFO: lr : [2024/08/01 17:45:05] ppocr INFO: learning_rate : 0.001 [2024/08/01 17:45:05] ppocr INFO: name : Adam [2024/08/01 17:45:05] ppocr INFO: regularizer : [2024/08/01 17:45:05] ppocr INFO: factor : 0 [2024/08/01 17:45:05] ppocr INFO: name : L2 [2024/08/01 17:45:05] ppocr INFO: PostProcess : [2024/08/01 17:45:05] ppocr INFO: box_thresh : 0.6 [2024/08/01 17:45:05] ppocr INFO: max_candidates : 1000 [2024/08/01 17:45:05] ppocr INFO: name : DBPostProcess [2024/08/01 17:45:05] ppocr INFO: thresh : 0.3 [2024/08/01 17:45:05] ppocr INFO: unclip_ratio : 1.5 [2024/08/01 17:45:05] ppocr INFO: Train : [2024/08/01 17:45:05] ppocr INFO: dataset : [2024/08/01 17:45:05] ppocr INFO: data_dir : /datasets/icdar2015/text_localization/ [2024/08/01 17:45:05] ppocr INFO: label_file_list : ['/datasets/icdar2015/text_localization/train_icdar2015_label.txt'] [2024/08/01 17:45:05] ppocr INFO: name : SimpleDataSet [2024/08/01 17:45:05] ppocr INFO: ratio_list : [1.0] [2024/08/01 17:45:05] ppocr INFO: transforms : [2024/08/01 17:45:05] ppocr INFO: DecodeImage : [2024/08/01 17:45:05] ppocr INFO: channel_first : False [2024/08/01 17:45:05] ppocr INFO: img_mode : BGR [2024/08/01 17:45:05] ppocr INFO: DetLabelEncode : None [2024/08/01 17:45:05] ppocr INFO: IaaAugment : [2024/08/01 17:45:05] ppocr INFO: augmenter_args : [2024/08/01 17:45:05] ppocr INFO: args : [2024/08/01 17:45:05] ppocr INFO: p : 0.5 [2024/08/01 17:45:05] ppocr INFO: type : Fliplr [2024/08/01 17:45:05] ppocr INFO: args : [2024/08/01 17:45:05] ppocr INFO: rotate : [-10, 10] [2024/08/01 17:45:05] ppocr INFO: type : Affine [2024/08/01 17:45:05] ppocr INFO: args : [2024/08/01 17:45:05] ppocr INFO: size : [0.5, 3] [2024/08/01 17:45:05] ppocr INFO: type : Resize [2024/08/01 17:45:05] ppocr INFO: EastRandomCropData : [2024/08/01 17:45:05] ppocr INFO: keep_ratio : True [2024/08/01 17:45:05] ppocr INFO: max_tries : 50 [2024/08/01 17:45:05] ppocr INFO: size : [640, 640] [2024/08/01 17:45:05] ppocr INFO: MakeBorderMap : [2024/08/01 17:45:05] ppocr INFO: shrink_ratio : 0.4 [2024/08/01 17:45:05] ppocr INFO: thresh_max : 0.7 [2024/08/01 17:45:05] ppocr INFO: thresh_min : 0.3 [2024/08/01 17:45:05] ppocr INFO: MakeShrinkMap : [2024/08/01 17:45:05] ppocr INFO: min_text_size : 8 [2024/08/01 17:45:05] ppocr INFO: shrink_ratio : 0.4 [2024/08/01 17:45:05] ppocr INFO: NormalizeImage : [2024/08/01 17:45:05] ppocr INFO: mean : [0.485, 0.456, 0.406] [2024/08/01 17:45:05] ppocr INFO: order : hwc [2024/08/01 17:45:05] ppocr INFO: scale : 1./255. [2024/08/01 17:45:05] ppocr INFO: std : [0.229, 0.224, 0.225] [2024/08/01 17:45:05] ppocr INFO: ToCHWImage : None [2024/08/01 17:45:05] ppocr INFO: KeepKeys : [2024/08/01 17:45:05] ppocr INFO: keep_keys : ['image', 'threshold_map', 'threshold_mask', 'shrink_map', 'shrink_mask'] [2024/08/01 17:45:05] ppocr INFO: loader : [2024/08/01 17:45:05] ppocr INFO: batch_size_per_card : 48 [2024/08/01 17:45:05] ppocr INFO: drop_last : False [2024/08/01 17:45:05] ppocr INFO: num_workers : 8 [2024/08/01 17:45:05] ppocr INFO: shuffle : True [2024/08/01 17:45:05] ppocr INFO: use_shared_memory : True [2024/08/01 17:45:05] ppocr INFO: profiler_options : None [2024/08/01 17:45:05] ppocr INFO: train with paddle 2.5.2 and device Place(gpu:0) ======================= Modified FLAGS detected ======================= FLAGS(name='FLAGS_selected_gpus', current_value='0', default_value='') FLAGS(name='FLAGS_cudnn_batchnorm_spatial_persistent', current_value=True, default_value=False) ======================================================================= I0801 17:45:05.476492 1057 tcp_utils.cc:181] The server starts to listen on IP_ANY:49295 I0801 17:45:05.476715 1057 tcp_utils.cc:130] Successfully connected to 10.8.145.246:49295 I0801 17:45:08.597571 1057 process_group_nccl.cc:120] ProcessGroupNCCL pg_timeout_ 1800000 [2024/08/01 17:45:08] ppocr INFO: Initialize indexs of datasets:['/datasets/icdar2015/text_localization/train_icdar2015_label.txt'] [2024/08/01 17:45:08] ppocr INFO: Initialize indexs of datasets:['/datasets/icdar2015/text_localization/test_icdar2015_label.txt'] W0801 17:45:08.610193 1057 gpu_resources.cc:119] Please NOTE: device: 0, GPU Compute Capability: 90.2, Driver API Version: 50724.2, Runtime API Version: 50724.2 [2024/08/01 17:45:10] ppocr INFO: load pretrain successful from ./pretrain_models/MobileNetV3_large_x0_5_pretrained [2024/08/01 17:45:10] ppocr INFO: train dataloader has 3 iters [2024/08/01 17:45:10] ppocr INFO: valid dataloader has 500 iters [2024/08/01 17:45:10] ppocr INFO: During the training process, after the 0th iteration, an evaluation is run every 60 iterations [2024/08/01 17:46:27] ppocr INFO: epoch: [1/100], global_step: 3, lr: 0.001000, loss: 9.286121, loss_shrink_maps: 4.932228, loss_threshold_maps: 3.392218, loss_binary_maps: 0.985882, avg_reader_cost: 12.85591 s, avg_batch_cost: 18.91408 s, avg_samples: 12.5, ips: 0.66088 samples/s, eta: 5:12:04 [2024/08/01 17:46:28] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:46:36] ppocr INFO: epoch: [2/100], global_step: 6, lr: 0.001000, loss: 8.548527, loss_shrink_maps: 4.929990, loss_threshold_maps: 2.632422, loss_binary_maps: 0.986115, avg_reader_cost: 2.20346 s, avg_batch_cost: 2.42593 s, avg_samples: 12.5, ips: 5.15267 samples/s, eta: 2:54:16 [2024/08/01 17:46:37] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:46:46] ppocr INFO: epoch: [3/100], global_step: 9, lr: 0.001000, loss: 7.804622, loss_shrink_maps: 4.927752, loss_threshold_maps: 1.853062, loss_binary_maps: 0.985882, avg_reader_cost: 2.19835 s, avg_batch_cost: 2.41719 s, avg_samples: 12.5, ips: 5.17130 samples/s, eta: 2:08:01 [2024/08/01 17:46:46] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:46:54] ppocr INFO: epoch: [4/100], global_step: 10, lr: 0.001000, loss: 7.545996, loss_shrink_maps: 4.928834, loss_threshold_maps: 1.624225, loss_binary_maps: 0.986062, avg_reader_cost: 0.68740 s, avg_batch_cost: 0.77541 s, avg_samples: 4.8, ips: 6.19027 samples/s, eta: 1:58:34 [2024/08/01 17:46:55] ppocr INFO: epoch: [4/100], global_step: 12, lr: 0.001000, loss: 7.237197, loss_shrink_maps: 4.927601, loss_threshold_maps: 1.334146, loss_binary_maps: 0.985817, avg_reader_cost: 1.63828 s, avg_batch_cost: 1.77769 s, avg_samples: 7.7, ips: 4.33147 samples/s, eta: 1:45:14 [2024/08/01 17:46:56] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:47:05] ppocr INFO: epoch: [5/100], global_step: 15, lr: 0.001000, loss: 7.130876, loss_shrink_maps: 4.927450, loss_threshold_maps: 1.216004, loss_binary_maps: 0.985418, avg_reader_cost: 2.27306 s, avg_batch_cost: 2.55231 s, avg_samples: 12.5, ips: 4.89753 samples/s, eta: 1:31:23 [2024/08/01 17:47:06] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:47:14] ppocr INFO: epoch: [6/100], global_step: 18, lr: 0.001000, loss: 7.104102, loss_shrink_maps: 4.924126, loss_threshold_maps: 1.187511, loss_binary_maps: 0.984908, avg_reader_cost: 2.21714 s, avg_batch_cost: 2.43917 s, avg_samples: 12.5, ips: 5.12469 samples/s, eta: 1:21:43 [2024/08/01 17:47:15] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:47:23] ppocr INFO: epoch: [7/100], global_step: 20, lr: 0.001000, loss: 7.077874, loss_shrink_maps: 4.920578, loss_threshold_maps: 1.158228, loss_binary_maps: 0.984056, avg_reader_cost: 1.42181 s, avg_batch_cost: 1.58732 s, avg_samples: 9.6, ips: 6.04795 samples/s, eta: 1:16:44 [2024/08/01 17:47:24] ppocr INFO: epoch: [7/100], global_step: 21, lr: 0.001000, loss: 7.067647, loss_shrink_maps: 4.916796, loss_threshold_maps: 1.156397, loss_binary_maps: 0.982678, avg_reader_cost: 0.83747 s, avg_batch_cost: 0.88965 s, avg_samples: 2.9, ips: 3.25971 samples/s, eta: 1:14:47 [2024/08/01 17:47:25] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:47:33] ppocr INFO: epoch: [8/100], global_step: 24, lr: 0.001000, loss: 7.047196, loss_shrink_maps: 4.914110, loss_threshold_maps: 1.148854, loss_binary_maps: 0.979226, avg_reader_cost: 2.22181 s, avg_batch_cost: 2.44873 s, avg_samples: 12.5, ips: 5.10469 samples/s, eta: 1:09:26 [2024/08/01 17:47:34] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:47:43] ppocr INFO: epoch: [9/100], global_step: 27, lr: 0.001000, loss: 7.011276, loss_shrink_maps: 4.911048, loss_threshold_maps: 1.123974, loss_binary_maps: 0.974819, avg_reader_cost: 2.26004 s, avg_batch_cost: 2.51024 s, avg_samples: 12.5, ips: 4.97961 samples/s, eta: 1:05:16 [2024/08/01 17:47:44] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:47:52] ppocr INFO: epoch: [10/100], global_step: 30, lr: 0.001000, loss: 6.940498, loss_shrink_maps: 4.902378, loss_threshold_maps: 1.077619, loss_binary_maps: 0.970784, avg_reader_cost: 2.21147 s, avg_batch_cost: 2.44738 s, avg_samples: 12.5, ips: 5.10749 samples/s, eta: 1:01:46 [2024/08/01 17:47:53] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:48:02] ppocr INFO: epoch: [11/100], global_step: 33, lr: 0.001000, loss: 6.868617, loss_shrink_maps: 4.885881, loss_threshold_maps: 1.038050, loss_binary_maps: 0.960971, avg_reader_cost: 2.22404 s, avg_batch_cost: 2.44256 s, avg_samples: 12.5, ips: 5.11758 samples/s, eta: 0:58:49 [2024/08/01 17:48:03] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:48:12] ppocr INFO: epoch: [12/100], global_step: 36, lr: 0.001000, loss: 6.817448, loss_shrink_maps: 4.864040, loss_threshold_maps: 1.009396, loss_binary_maps: 0.956228, avg_reader_cost: 2.26320 s, avg_batch_cost: 2.48832 s, avg_samples: 12.5, ips: 5.02348 samples/s, eta: 0:56:21 [2024/08/01 17:48:12] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:48:21] ppocr INFO: epoch: [13/100], global_step: 39, lr: 0.001000, loss: 6.791888, loss_shrink_maps: 4.857442, loss_threshold_maps: 0.978082, loss_binary_maps: 0.947377, avg_reader_cost: 2.31176 s, avg_batch_cost: 2.53060 s, avg_samples: 12.5, ips: 4.93953 samples/s, eta: 0:54:15 [2024/08/01 17:48:22] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:48:29] ppocr INFO: epoch: [14/100], global_step: 40, lr: 0.001000, loss: 6.778063, loss_shrink_maps: 4.856284, loss_threshold_maps: 0.968342, loss_binary_maps: 0.946886, avg_reader_cost: 0.65116 s, avg_batch_cost: 0.74874 s, avg_samples: 4.8, ips: 6.41073 samples/s, eta: 0:53:30 [2024/08/01 17:48:31] ppocr INFO: epoch: [14/100], global_step: 42, lr: 0.001000, loss: 6.729544, loss_shrink_maps: 4.851938, loss_threshold_maps: 0.954702, loss_binary_maps: 0.946146, avg_reader_cost: 1.58592 s, avg_batch_cost: 1.72608 s, avg_samples: 7.7, ips: 4.46097 samples/s, eta: 0:52:20 [2024/08/01 17:48:32] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:48:40] ppocr INFO: epoch: [15/100], global_step: 45, lr: 0.001000, loss: 6.668135, loss_shrink_maps: 4.836268, loss_threshold_maps: 0.933070, loss_binary_maps: 0.927373, avg_reader_cost: 2.23363 s, avg_batch_cost: 2.45210 s, avg_samples: 12.5, ips: 5.09768 samples/s, eta: 0:50:35 [2024/08/01 17:48:41] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:48:50] ppocr INFO: epoch: [16/100], global_step: 48, lr: 0.001000, loss: 6.658508, loss_shrink_maps: 4.823704, loss_threshold_maps: 0.926389, loss_binary_maps: 0.910777, avg_reader_cost: 2.16004 s, avg_batch_cost: 2.40701 s, avg_samples: 12.5, ips: 5.19315 samples/s, eta: 0:48:58 [2024/08/01 17:48:50] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:48:58] ppocr INFO: epoch: [17/100], global_step: 50, lr: 0.001000, loss: 6.639746, loss_shrink_maps: 4.820710, loss_threshold_maps: 0.918938, loss_binary_maps: 0.902400, avg_reader_cost: 1.34973 s, avg_batch_cost: 1.52841 s, avg_samples: 9.6, ips: 6.28102 samples/s, eta: 0:47:55 [2024/08/01 17:48:59] ppocr INFO: epoch: [17/100], global_step: 51, lr: 0.001000, loss: 6.622952, loss_shrink_maps: 4.820710, loss_threshold_maps: 0.912991, loss_binary_maps: 0.890444, avg_reader_cost: 0.80877 s, avg_batch_cost: 0.86062 s, avg_samples: 2.9, ips: 3.36965 samples/s, eta: 0:47:29 [2024/08/01 17:49:00] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:49:08] ppocr INFO: epoch: [18/100], global_step: 54, lr: 0.001000, loss: 6.563270, loss_shrink_maps: 4.818290, loss_threshold_maps: 0.883130, loss_binary_maps: 0.867894, avg_reader_cost: 2.23478 s, avg_batch_cost: 2.49605 s, avg_samples: 12.5, ips: 5.00791 samples/s, eta: 0:46:12 [2024/08/01 17:49:09] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:49:18] ppocr INFO: epoch: [19/100], global_step: 57, lr: 0.001000, loss: 6.473013, loss_shrink_maps: 4.817668, loss_threshold_maps: 0.883047, loss_binary_maps: 0.807621, avg_reader_cost: 2.22523 s, avg_batch_cost: 2.44413 s, avg_samples: 12.5, ips: 5.11430 samples/s, eta: 0:44:58 [2024/08/01 17:49:19] ppocr INFO: save model in ./output/db_mv3/latest [2024/08/01 17:49:27] ppocr INFO: epoch: [20/100], global_step: 60, lr: 0.001000, loss: 6.351774, loss_shrink_maps: 4.817668, loss_threshold_maps: 0.874931, loss_binary_maps: 0.712683, avg_reader_cost: 2.18743 s, avg_batch_cost: 2.42843 s, avg_samples: 12.5, ips: 5.14736 samples/s, eta: 0:43:49 eval model:: 0%| | 0/500 [00:00