INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: resnet50-tf-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: open_imagenet
INFO:Imagenet:Initial...

0it [00:00, ?it/s]
9265it [00:00, 92645.01it/s]
31721it [00:00, 170236.62it/s]
50000it [00:00, 178218.93it/s]
INFO:Imagenet:reduced image list, 45000 images not found
INFO:Imagenet:loaded 5000 images, cache=0, took=0.3sec
INFO:Imagenet:Preprocessing...
INFO:Imagenet:Rebatching batch size to: 1 ...

  0%|          | 0/5000 [00:00<?, ?it/s]
  4%|▎         | 177/5000 [00:00<00:02, 1767.72it/s]
  7%|▋         | 355/5000 [00:00<00:02, 1771.08it/s]
 11%|█         | 534/5000 [00:00<00:02, 1779.36it/s]
 14%|█▍        | 716/5000 [00:00<00:02, 1794.49it/s]
 18%|█▊        | 896/5000 [00:00<00:02, 1794.49it/s]
 22%|██▏       | 1080/5000 [00:00<00:02, 1809.24it/s]
 25%|██▌       | 1264/5000 [00:00<00:02, 1817.38it/s]
 29%|██▉       | 1447/5000 [00:00<00:01, 1817.85it/s]
 33%|███▎      | 1633/5000 [00:00<00:01, 1829.06it/s]
 36%|███▋      | 1818/5000 [00:01<00:01, 1835.16it/s]
 40%|████      | 2003/5000 [00:01<00:01, 1837.14it/s]
 44%|████▎     | 2187/5000 [00:01<00:01, 1833.66it/s]
 47%|████▋     | 2371/5000 [00:01<00:01, 1833.66it/s]
 51%|█████     | 2556/5000 [00:01<00:01, 1837.28it/s]
 55%|█████▍    | 2740/5000 [00:01<00:01, 1834.83it/s]
 58%|█████▊    | 2924/5000 [00:01<00:01, 1835.65it/s]
 62%|██████▏   | 3112/5000 [00:01<00:01, 1846.61it/s]
 66%|██████▌   | 3297/5000 [00:01<00:00, 1847.08it/s]
 70%|██████▉   | 3482/5000 [00:01<00:00, 1843.11it/s]
 73%|███████▎  | 3668/5000 [00:02<00:00, 1846.73it/s]
 77%|███████▋  | 3855/5000 [00:02<00:00, 1851.02it/s]
 81%|████████  | 4041/5000 [00:02<00:00, 1852.22it/s]
 85%|████████▍ | 4227/5000 [00:02<00:00, 1849.42it/s]
 88%|████████▊ | 4414/5000 [00:02<00:00, 1853.42it/s]
 92%|█████████▏| 4600/5000 [00:02<00:00, 1852.90it/s]
 96%|█████████▌| 4786/5000 [00:02<00:00, 1847.07it/s]
 99%|█████████▉| 4974/5000 [00:02<00:00, 1854.41it/s]
100%|██████████| 5000/5000 [00:02<00:00, 1834.66it/s]
INFO:PerfEngine:Start to compile the model...
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:Imagenet:Rebatching batch size to: 4 ...

  0%|          | 0/1250 [00:00<?, ?it/s]
  5%|▍         | 62/1250 [00:00<00:01, 611.78it/s]
 10%|▉         | 124/1250 [00:00<00:02, 507.21it/s]
 14%|█▍        | 176/1250 [00:00<00:02, 478.38it/s]
 18%|█▊        | 225/1250 [00:00<00:02, 465.93it/s]
 22%|██▏       | 272/1250 [00:00<00:02, 461.66it/s]
 26%|██▌       | 319/1250 [00:00<00:02, 459.86it/s]
 29%|██▉       | 366/1250 [00:00<00:01, 457.09it/s]
 33%|███▎      | 412/1250 [00:00<00:01, 454.87it/s]
 37%|███▋      | 458/1250 [00:00<00:01, 452.81it/s]
 40%|████      | 504/1250 [00:01<00:01, 451.72it/s]
 44%|████▍     | 550/1250 [00:01<00:01, 451.50it/s]
 48%|████▊     | 596/1250 [00:01<00:01, 451.14it/s]
 51%|█████▏    | 642/1250 [00:01<00:01, 450.97it/s]
 55%|█████▌    | 688/1250 [00:01<00:01, 450.63it/s]
 59%|█████▊    | 734/1250 [00:01<00:01, 450.70it/s]
 62%|██████▏   | 780/1250 [00:01<00:01, 450.69it/s]
 66%|██████▌   | 826/1250 [00:01<00:00, 451.79it/s]
 70%|██████▉   | 872/1250 [00:01<00:00, 453.23it/s]
 73%|███████▎  | 918/1250 [00:02<00:00, 452.97it/s]
 77%|███████▋  | 964/1250 [00:02<00:00, 452.63it/s]
 81%|████████  | 1010/1250 [00:02<00:00, 451.31it/s]
 84%|████████▍ | 1056/1250 [00:02<00:00, 450.84it/s]
 88%|████████▊ | 1102/1250 [00:02<00:00, 451.02it/s]
 92%|█████████▏| 1148/1250 [00:02<00:00, 450.13it/s]
 96%|█████████▌| 1194/1250 [00:02<00:00, 450.20it/s]
 99%|█████████▉| 1240/1250 [00:02<00:00, 450.28it/s]
100%|██████████| 1250/1250 [00:02<00:00, 456.54it/s]
INFO:TestAccuracy:Start to calculate accuracy...

  0%|          | 0/1250 [00:00<?, ?it/s]WARNING:absl:`input_tensor:0` is not a valid tf.function parameter name. Sanitizing to `input_tensor_0`.

  0%|          | 1/1250 [00:08<2:47:44,  8.06s/it]WARNING:absl:`input_tensor:0` is not a valid tf.function parameter name. Sanitizing to `input_tensor_0`.
WARNING:absl:`input_tensor:0` is not a valid tf.function parameter name. Sanitizing to `input_tensor_0`.
WARNING:absl:`input_tensor:0` is not a valid tf.function parameter name. Sanitizing to `input_tensor_0`.
WARNING:absl:`input_tensor:0` is not a valid tf.function parameter name. Sanitizing to `input_tensor_0`.

  1%|          | 12/1250 [00:08<10:07,  2.04it/s] 
  2%|▏         | 23/1250 [00:08<04:23,  4.65it/s]
  3%|▎         | 33/1250 [00:08<02:35,  7.84it/s]
  3%|▎         | 43/1250 [00:08<01:40, 12.01it/s]
  4%|▍         | 53/1250 [00:08<01:09, 17.31it/s]
  5%|▌         | 63/1250 [00:08<00:49, 23.77it/s]
  6%|▌         | 73/1250 [00:08<00:37, 31.28it/s]
  7%|▋         | 83/1250 [00:08<00:29, 39.55it/s]
  7%|▋         | 93/1250 [00:09<00:24, 48.09it/s]
  8%|▊         | 103/1250 [00:09<00:20, 56.40it/s]
  9%|▉         | 113/1250 [00:09<00:17, 64.01it/s]
 10%|▉         | 123/1250 [00:09<00:16, 70.41it/s]
 11%|█         | 133/1250 [00:09<00:14, 76.15it/s]
 11%|█▏        | 143/1250 [00:09<00:13, 80.78it/s]
 12%|█▏        | 153/1250 [00:09<00:13, 84.25it/s]
 13%|█▎        | 163/1250 [00:09<00:12, 86.89it/s]
 14%|█▍        | 173/1250 [00:09<00:12, 88.94it/s]
 15%|█▍        | 183/1250 [00:09<00:11, 90.34it/s]
 15%|█▌        | 193/1250 [00:10<00:11, 91.44it/s]
 16%|█▌        | 203/1250 [00:10<00:11, 92.18it/s]
 17%|█▋        | 213/1250 [00:10<00:11, 92.46it/s]
 18%|█▊        | 223/1250 [00:10<00:11, 92.91it/s]
 19%|█▊        | 233/1250 [00:10<00:10, 93.21it/s]
 19%|█▉        | 243/1250 [00:10<00:10, 92.96it/s]
 20%|██        | 253/1250 [00:10<00:10, 93.32it/s]
 21%|██        | 263/1250 [00:10<00:10, 93.54it/s]
 22%|██▏       | 273/1250 [00:10<00:10, 93.60it/s]
 23%|██▎       | 283/1250 [00:11<00:10, 93.76it/s]
 23%|██▎       | 293/1250 [00:11<00:10, 93.72it/s]
 24%|██▍       | 303/1250 [00:11<00:10, 93.67it/s]
 25%|██▌       | 314/1250 [00:11<00:09, 97.14it/s]
 26%|██▌       | 324/1250 [00:11<00:09, 96.99it/s]
 27%|██▋       | 334/1250 [00:11<00:09, 96.10it/s]
 28%|██▊       | 344/1250 [00:11<00:09, 95.57it/s]
 28%|██▊       | 354/1250 [00:11<00:09, 95.17it/s]
 29%|██▉       | 364/1250 [00:11<00:09, 94.76it/s]
 30%|██▉       | 374/1250 [00:11<00:09, 94.06it/s]
 31%|███       | 384/1250 [00:12<00:09, 94.04it/s]
 32%|███▏      | 394/1250 [00:12<00:09, 93.99it/s]
 32%|███▏      | 404/1250 [00:12<00:09, 93.84it/s]
 33%|███▎      | 414/1250 [00:12<00:08, 93.97it/s]
 34%|███▍      | 424/1250 [00:12<00:08, 93.91it/s]
 35%|███▍      | 434/1250 [00:12<00:08, 93.83it/s]
 36%|███▌      | 444/1250 [00:12<00:08, 93.98it/s]
 36%|███▋      | 454/1250 [00:12<00:08, 93.84it/s]
 37%|███▋      | 464/1250 [00:12<00:08, 93.94it/s]
 38%|███▊      | 474/1250 [00:13<00:08, 93.90it/s]
 39%|███▊      | 484/1250 [00:13<00:08, 93.92it/s]
 40%|███▉      | 494/1250 [00:13<00:08, 93.33it/s]
 40%|████      | 504/1250 [00:13<00:07, 93.44it/s]
 41%|████      | 514/1250 [00:13<00:07, 93.58it/s]
 42%|████▏     | 524/1250 [00:13<00:07, 93.76it/s]
 43%|████▎     | 534/1250 [00:13<00:07, 93.86it/s]
 44%|████▎     | 544/1250 [00:13<00:07, 93.86it/s]
 44%|████▍     | 554/1250 [00:13<00:07, 93.89it/s]
 45%|████▌     | 564/1250 [00:14<00:07, 93.87it/s]
 46%|████▌     | 574/1250 [00:14<00:07, 93.82it/s]
 47%|████▋     | 584/1250 [00:14<00:07, 93.76it/s]
 48%|████▊     | 594/1250 [00:14<00:07, 93.64it/s]
 48%|████▊     | 604/1250 [00:14<00:06, 93.63it/s]
 49%|████▉     | 614/1250 [00:14<00:06, 93.83it/s]
 50%|████▉     | 624/1250 [00:14<00:06, 93.00it/s]
 51%|█████     | 634/1250 [00:14<00:06, 93.33it/s]
 52%|█████▏    | 644/1250 [00:14<00:06, 93.56it/s]
 52%|█████▏    | 654/1250 [00:14<00:06, 93.73it/s]
 53%|█████▎    | 664/1250 [00:15<00:06, 93.80it/s]
 54%|█████▍    | 674/1250 [00:15<00:06, 93.81it/s]
 55%|█████▍    | 684/1250 [00:15<00:06, 93.64it/s]
 56%|█████▌    | 694/1250 [00:15<00:05, 93.66it/s]
 56%|█████▋    | 704/1250 [00:15<00:05, 93.64it/s]
 57%|█████▋    | 714/1250 [00:15<00:05, 93.78it/s]
 58%|█████▊    | 724/1250 [00:15<00:05, 93.66it/s]
 59%|█████▊    | 734/1250 [00:15<00:05, 93.78it/s]
 60%|█████▉    | 744/1250 [00:15<00:05, 93.21it/s]
 60%|██████    | 754/1250 [00:16<00:05, 93.43it/s]
 61%|██████    | 764/1250 [00:16<00:05, 93.54it/s]
 62%|██████▏   | 774/1250 [00:16<00:05, 93.44it/s]
 63%|██████▎   | 784/1250 [00:16<00:04, 93.64it/s]
 64%|██████▎   | 794/1250 [00:16<00:04, 93.85it/s]
 64%|██████▍   | 804/1250 [00:16<00:04, 93.87it/s]
 65%|██████▌   | 814/1250 [00:16<00:04, 94.00it/s]
 66%|██████▌   | 824/1250 [00:16<00:04, 93.96it/s]
 67%|██████▋   | 834/1250 [00:16<00:04, 93.97it/s]
 68%|██████▊   | 844/1250 [00:17<00:04, 93.86it/s]
 68%|██████▊   | 854/1250 [00:17<00:04, 93.85it/s]
 69%|██████▉   | 864/1250 [00:17<00:04, 93.73it/s]
 70%|██████▉   | 874/1250 [00:17<00:04, 93.14it/s]
 71%|███████   | 884/1250 [00:17<00:03, 93.29it/s]
 72%|███████▏  | 894/1250 [00:17<00:03, 93.36it/s]
 72%|███████▏  | 904/1250 [00:17<00:03, 93.44it/s]
 73%|███████▎  | 914/1250 [00:17<00:03, 93.69it/s]
 74%|███████▍  | 924/1250 [00:17<00:03, 93.89it/s]
 75%|███████▍  | 934/1250 [00:17<00:03, 94.01it/s]
 76%|███████▌  | 944/1250 [00:18<00:03, 94.03it/s]
 76%|███████▋  | 954/1250 [00:18<00:03, 94.05it/s]
 77%|███████▋  | 964/1250 [00:18<00:03, 94.01it/s]
 78%|███████▊  | 974/1250 [00:18<00:02, 93.95it/s]
 79%|███████▊  | 984/1250 [00:18<00:02, 93.93it/s]
 80%|███████▉  | 994/1250 [00:18<00:02, 93.80it/s]
 80%|████████  | 1004/1250 [00:18<00:02, 93.41it/s]
 81%|████████  | 1014/1250 [00:18<00:02, 93.64it/s]
 82%|████████▏ | 1024/1250 [00:18<00:02, 93.62it/s]
 83%|████████▎ | 1034/1250 [00:19<00:02, 93.82it/s]
 84%|████████▎ | 1044/1250 [00:19<00:02, 93.96it/s]
 84%|████████▍ | 1054/1250 [00:19<00:02, 93.99it/s]
 85%|████████▌ | 1064/1250 [00:19<00:01, 94.15it/s]
 86%|████████▌ | 1074/1250 [00:19<00:01, 94.10it/s]
 87%|████████▋ | 1084/1250 [00:19<00:01, 94.09it/s]
 88%|████████▊ | 1094/1250 [00:19<00:01, 94.07it/s]
 88%|████████▊ | 1104/1250 [00:19<00:01, 94.14it/s]
 89%|████████▉ | 1114/1250 [00:19<00:01, 94.11it/s]
 90%|████████▉ | 1124/1250 [00:19<00:01, 93.26it/s]
 91%|█████████ | 1134/1250 [00:20<00:01, 93.54it/s]
 92%|█████████▏| 1144/1250 [00:20<00:01, 93.75it/s]
 92%|█████████▏| 1154/1250 [00:20<00:01, 93.73it/s]
 93%|█████████▎| 1164/1250 [00:20<00:00, 93.84it/s]
 94%|█████████▍| 1174/1250 [00:20<00:00, 93.80it/s]
 95%|█████████▍| 1184/1250 [00:20<00:00, 93.50it/s]
 96%|█████████▌| 1194/1250 [00:20<00:00, 93.64it/s]
 96%|█████████▋| 1204/1250 [00:20<00:00, 93.79it/s]
 97%|█████████▋| 1214/1250 [00:20<00:00, 93.91it/s]
 98%|█████████▊| 1224/1250 [00:21<00:00, 94.01it/s]
 99%|█████████▊| 1234/1250 [00:21<00:00, 94.02it/s]
100%|█████████▉| 1244/1250 [00:21<00:00, 94.09it/s]
100%|██████████| 1250/1250 [00:21<00:00, 58.57it/s]
INFO:TestAccuracy:Batch size is 4, Accuracy: 0.772
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 4, QPS: 471, Avg Latency:8.49, Tail Latency:8.81
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 8, QPS: 562, Avg Latency:14.22, Tail Latency:16.69
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 16, QPS: 768, Avg Latency:20.83, Tail Latency:21.58
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 32, QPS: 866, Avg Latency:36.94, Tail Latency:39.22
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 64, QPS: 910, Avg Latency:70.26, Tail Latency:72.84
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/resnet50-tf-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/resnet50-tf-fp32/RESNET50-TF-FP32-TO-FP32.JSON.pdf ]
Exception ignored in: <function AtomicFunction.__del__ at 0x7f51cc184af0>
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
Exception ignored in: <function AtomicFunction.__del__ at 0x7f51cc184af0>
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
Exception ignored in: <function AtomicFunction.__del__ at 0x7f51cc184af0>
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable