Skip to content

GitLab

Commit 24b257f1 authored by sunzhq2's avatar sunzhq2
Browse files

init

parent 920b3c0f
Hide whitespace changes
Inline Side-by-side
Showing with 2433 additions and 0 deletions
ByteMLPerf/byte_infer_perf/general_perf/log/roberta-torch-fp32.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: roberta-torch-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: open_squad
INFO:SQUAD:Initial...
INFO:SQUAD:Preprocessing...
INFO:SQUAD:Rebatching batch size to: 11137 ...
0%| | 0/1 [00:00<?, ?it/s] 100%|██████████| 1/1 [00:00<00:00, 42.38it/s]
INFO:PerfEngine:Start to compile the model...
INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:SQUAD:Rebatching batch size to: 1 ...
0%| | 0/11137 [00:00<?, ?it/s] 67%|██████▋ | 7488/11137 [00:00<00:00, 24883.10it/s] 100%|██████████| 11137/11137 [00:00<00:00, 35677.54it/s]
INFO:TestAccuracy:Start to calculate accuracy...
0%| | 0/11137 [00:00<?, ?it/s]/home/workspace/ByteMLPerf/byte_infer_perf/general_perf/backends/DCU/runtime_backend_dcu.py:81: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at /data/jenkins_workspace/workspace/pytorch@4/torch/csrc/utils/tensor_new.cpp:261.)
torch.tensor(feeds[key],
0%| | 1/11137 [00:04<12:48:33, 4.14s/it] 0%| | 6/11137 [00:04<1:37:47, 1.90it/s] 0%| | 18/11137 [00:04<25:37, 7.23it/s] 0%| | 30/11137 [00:04<13:12, 14.01it/s] 0%| | 42/11137 [00:04<08:17, 22.30it/s] 0%| | 54/11137 [00:04<05:46, 31.97it/s] 1%| | 66/11137 [00:04<04:19, 42.66it/s] 1%| | 78/11137 [00:04<03:25, 53.72it/s] 1%| | 90/11137 [00:04<02:51, 64.56it/s] 1%| | 102/11137 [00:05<02:28, 74.42it/s] 1%| | 113/11137 [00:05<02:14, 82.01it/s] 1%| | 125/11137 [00:05<02:02, 89.56it/s] 1%| | 137/11137 [00:05<01:55, 95.35it/s] 1%|▏ | 149/11137 [00:05<01:50, 99.70it/s] 1%|▏ | 161/11137 [00:05<01:46, 103.02it/s] 2%|▏ | 173/11137 [00:05<01:44, 105.32it/s] 2%|▏ | 185/11137 [00:05<01:42, 107.10it/s] 2%|▏ | 197/11137 [00:05<01:40, 108.37it/s] 2%|▏ | 209/11137 [00:06<01:39, 109.31it/s] 2%|▏ | 221/11137 [00:06<01:39, 109.85it/s] 2%|▏ | 233/11137 [00:06<01:38, 110.19it/s] 2%|▏ | 245/11137 [00:06<01:38, 110.72it/s] 2%|▏ | 257/11137 [00:06<01:37, 111.06it/s] 2%|▏ | 269/11137 [00:06<01:38, 110.42it/s] 3%|▎ | 281/11137 [00:06<01:37, 110.80it/s] 3%|▎ | 293/11137 [00:06<01:37, 111.06it/s] 3%|▎ | 305/11137 [00:06<01:37, 110.91it/s] 3%|▎ | 317/11137 [00:07<01:37, 111.06it/s] 3%|▎ | 329/11137 [00:07<01:37, 111.16it/s] 3%|▎ | 341/11137 [00:07<01:37, 111.24it/s] 3%|▎ | 353/11137 [00:07<01:36, 111.21it/s] 3%|▎ | 365/11137 [00:07<01:36, 111.29it/s] 3%|▎ | 377/11137 [00:07<01:36, 111.31it/s] 3%|▎ | 389/11137 [00:07<01:36, 111.34it/s] 4%|▎ | 401/11137 [00:07<01:36, 111.43it/s] 4%|▎ | 413/11137 [00:07<01:36, 110.84it/s] 4%|▍ | 425/11137 [00:08<01:36, 111.05it/s] 4%|▍ | 437/11137 [00:08<01:36, 111.08it/s] 4%|▍ | 449/11137 [00:08<01:36, 111.05it/s] 4%|▍ | 461/11137 [00:08<01:36, 111.03it/s] 4%|▍ | 473/11137 [00:08<01:35, 111.20it/s] 4%|▍ | 485/11137 [00:08<01:35, 111.38it/s] 4%|▍ | 497/11137 [00:08<01:35, 111.46it/s] 5%|▍ | 509/11137 [00:08<01:36, 110.38it/s] 5%|▍ | 521/11137 [00:08<01:35, 110.66it/s] 5%|▍ | 533/11137 [00:08<01:35, 110.94it/s] 5%|▍ | 545/11137 [00:09<01:35, 111.16it/s] 5%|▌ | 557/11137 [00:09<01:35, 110.39it/s] 5%|▌ | 569/11137 [00:09<01:35, 110.78it/s] 5%|▌ | 581/11137 [00:09<01:35, 110.74it/s] 5%|▌ | 593/11137 [00:09<01:35, 110.89it/s] 5%|▌ | 605/11137 [00:09<01:34, 111.02it/s] 6%|▌ | 617/11137 [00:09<01:34, 111.13it/s] 6%|▌ | 629/11137 [00:09<01:34, 111.31it/s] 6%|▌ | 641/11137 [00:09<01:34, 111.45it/s] 6%|▌ | 653/11137 [00:10<01:34, 111.35it/s] 6%|▌ | 665/11137 [00:10<01:34, 111.37it/s] 6%|▌ | 677/11137 [00:10<01:33, 111.53it/s] 6%|▌ | 689/11137 [00:10<01:33, 111.49it/s] 6%|▋ | 701/11137 [00:10<01:33, 111.48it/s] 6%|▋ | 713/11137 [00:10<01:34, 110.76it/s] 7%|▋ | 725/11137 [00:10<01:33, 110.97it/s] 7%|▋ | 737/11137 [00:10<01:33, 111.05it/s] 7%|▋ | 749/11137 [00:10<01:33, 111.25it/s] 7%|▋ | 761/11137 [00:11<01:33, 111.31it/s] 7%|▋ | 773/11137 [00:11<01:33, 111.16it/s] 7%|▋ | 785/11137 [00:11<01:33, 111.19it/s] 7%|▋ | 797/11137 [00:11<01:32, 111.40it/s] 7%|▋ | 809/11137 [00:11<01:32, 111.18it/s] 7%|▋ | 821/11137 [00:11<01:32, 111.19it/s] 7%|▋ | 833/11137 [00:11<01:32, 111.15it/s] 8%|▊ | 845/11137 [00:11<01:32, 111.25it/s] 8%|▊ | 857/11137 [00:11<01:33, 110.50it/s] 8%|▊ | 869/11137 [00:12<01:32, 110.67it/s] 8%|▊ | 881/11137 [00:12<01:32, 110.84it/s] 8%|▊ | 893/11137 [00:12<01:32, 110.97it/s] 8%|▊ | 905/11137 [00:12<01:32, 111.08it/s] 8%|▊ | 917/11137 [00:12<01:31, 111.23it/s] 8%|▊ | 929/11137 [00:12<01:31, 111.23it/s] 8%|▊ | 941/11137 [00:12<01:31, 111.24it/s] 9%|▊ | 953/11137 [00:12<01:31, 111.37it/s] 9%|▊ | 965/11137 [00:12<01:31, 111.41it/s] 9%|▉ | 977/11137 [00:12<01:31, 111.37it/s] 9%|▉ | 989/11137 [00:13<01:31, 111.39it/s] 9%|▉ | 1001/11137 [00:13<01:30, 111.48it/s] 9%|▉ | 1013/11137 [00:13<01:31, 110.60it/s] 9%|▉ | 1025/11137 [00:13<01:31, 110.92it/s] 9%|▉ | 1037/11137 [00:13<01:30, 111.05it/s] 9%|▉ | 1049/11137 [00:13<01:30, 111.19it/s] 10%|▉ | 1061/11137 [00:13<01:30, 111.32it/s] 10%|▉ | 1073/11137 [00:13<01:30, 111.32it/s] 10%|▉ | 1085/11137 [00:13<01:30, 111.47it/s] 10%|▉ | 1097/11137 [00:14<01:29, 111.67it/s] 10%|▉ | 1109/11137 [00:14<01:29, 111.71it/s] 10%|█ | 1121/11137 [00:14<01:29, 111.57it/s] 10%|█ | 1133/11137 [00:14<01:29, 111.63it/s] 10%|█ | 1145/11137 [00:14<01:29, 111.62it/s] 10%|█ | 1157/11137 [00:14<01:29, 110.89it/s] 10%|█ | 1169/11137 [00:14<01:29, 111.11it/s] 11%|█ | 1181/11137 [00:14<01:29, 111.27it/s] 11%|█ | 1193/11137 [00:14<01:29, 111.26it/s] 11%|█ | 1205/11137 [00:15<01:29, 111.43it/s] 11%|█ | 1217/11137 [00:15<01:29, 111.36it/s] 11%|█ | 1229/11137 [00:15<01:28, 111.45it/s] 11%|█ | 1241/11137 [00:15<01:28, 111.40it/s] 11%|█▏ | 1253/11137 [00:15<01:28, 111.62it/s] 11%|█▏ | 1265/11137 [00:15<01:28, 111.61it/s] 11%|█▏ | 1277/11137 [00:15<01:28, 111.62it/s] 12%|█▏ | 1289/11137 [00:15<01:28, 111.68it/s] 12%|█▏ | 1301/11137 [00:15<01:28, 111.65it/s] 12%|█▏ | 1313/11137 [00:15<01:28, 110.83it/s] 12%|█▏ | 1325/11137 [00:16<01:28, 111.02it/s] 12%|█▏ | 1337/11137 [00:16<01:28, 111.15it/s] 12%|█▏ | 1349/11137 [00:16<01:28, 111.15it/s] 12%|█▏ | 1361/11137 [00:16<01:27, 111.30it/s] 12%|█▏ | 1373/11137 [00:16<01:27, 111.34it/s] 12%|█▏ | 1385/11137 [00:16<01:27, 111.47it/s] 13%|█▎ | 1397/11137 [00:16<01:27, 111.44it/s] 13%|█▎ | 1409/11137 [00:16<01:27, 111.55it/s] 13%|█▎ | 1421/11137 [00:16<01:27, 111.45it/s] 13%|█▎ | 1433/11137 [00:17<01:27, 111.46it/s] 13%|█▎ | 1445/11137 [00:17<01:26, 111.47it/s] 13%|█▎ | 1457/11137 [00:17<01:27, 110.66it/s] 13%|█▎ | 1469/11137 [00:17<01:27, 111.00it/s] 13%|█▎ | 1481/11137 [00:17<01:27, 110.96it/s] 13%|█▎ | 1493/11137 [00:17<01:26, 111.12it/s] 14%|█▎ | 1505/11137 [00:17<01:26, 111.35it/s] 14%|█▎ | 1517/11137 [00:17<01:26, 111.22it/s] 14%|█▎ | 1529/11137 [00:17<01:26, 111.13it/s] 14%|█▍ | 1541/11137 [00:18<01:26, 111.29it/s] 14%|█▍ | 1553/11137 [00:18<01:25, 111.44it/s] 14%|█▍ | 1565/11137 [00:18<01:25, 111.35it/s] 14%|█▍ | 1577/11137 [00:18<01:25, 111.45it/s] 14%|█▍ | 1589/11137 [00:18<01:25, 111.65it/s] 14%|█▍ | 1601/11137 [00:18<01:26, 110.76it/s] 14%|█▍ | 1613/11137 [00:18<01:25, 110.96it/s] 15%|█▍ | 1625/11137 [00:18<01:25, 111.10it/s] 15%|█▍ | 1637/11137 [00:18<01:25, 111.11it/s] 15%|█▍ | 1649/11137 [00:19<01:25, 111.22it/s] 15%|█▍ | 1661/11137 [00:19<01:25, 111.28it/s] 15%|█▌ | 1673/11137 [00:19<01:25, 111.32it/s] 15%|█▌ | 1685/11137 [00:19<01:24, 111.26it/s] 15%|█▌ | 1697/11137 [00:19<01:24, 111.16it/s] 15%|█▌ | 1709/11137 [00:19<01:24, 111.36it/s] 15%|█▌ | 1721/11137 [00:19<01:24, 111.37it/s] 16%|█▌ | 1733/11137 [00:19<01:24, 111.54it/s] 16%|█▌ | 1745/11137 [00:19<01:24, 111.56it/s] 16%|█▌ | 1757/11137 [00:19<01:24, 110.82it/s] 16%|█▌ | 1769/11137 [00:20<01:24, 111.03it/s] 16%|█▌ | 1781/11137 [00:20<01:24, 111.05it/s] 16%|█▌ | 1793/11137 [00:20<01:24, 111.24it/s] 16%|█▌ | 1805/11137 [00:20<01:23, 111.35it/s] 16%|█▋ | 1817/11137 [00:20<01:23, 111.30it/s] 16%|█▋ | 1829/11137 [00:20<01:23, 111.44it/s] 17%|█▋ | 1841/11137 [00:20<01:23, 111.58it/s] 17%|█▋ | 1853/11137 [00:20<01:23, 111.60it/s] 17%|█▋ | 1865/11137 [00:20<01:23, 111.66it/s] 17%|█▋ | 1877/11137 [00:21<01:23, 111.54it/s] 17%|█▋ | 1889/11137 [00:21<01:22, 111.69it/s] 17%|█▋ | 1901/11137 [00:21<01:23, 111.05it/s] 17%|█▋ | 1913/11137 [00:21<01:22, 111.22it/s] 17%|█▋ | 1925/11137 [00:21<01:22, 111.41it/s] 17%|█▋ | 1937/11137 [00:21<01:22, 111.28it/s] 18%|█▊ | 1949/11137 [00:21<01:22, 111.37it/s] 18%|█▊ | 1961/11137 [00:21<01:22, 111.36it/s] 18%|█▊ | 1973/11137 [00:21<01:22, 111.41it/s] 18%|█▊ | 1985/11137 [00:22<01:22, 111.47it/s] 18%|█▊ | 1997/11137 [00:22<01:21, 111.55it/s] 18%|█▊ | 2009/11137 [00:22<01:21, 111.46it/s] 18%|█▊ | 2021/11137 [00:22<01:21, 111.32it/s] 18%|█▊ | 2033/11137 [00:22<01:21, 111.45it/s] 18%|█▊ | 2045/11137 [00:22<01:21, 111.28it/s] 18%|█▊ | 2057/11137 [00:22<01:22, 110.48it/s] 19%|█▊ | 2069/11137 [00:22<01:21, 110.70it/s] 19%|█▊ | 2081/11137 [00:22<01:21, 110.79it/s] 19%|█▉ | 2093/11137 [00:23<01:21, 111.05it/s] 19%|█▉ | 2105/11137 [00:23<01:21, 111.27it/s] 19%|█▉ | 2117/11137 [00:23<01:21, 111.34it/s] 19%|█▉ | 2129/11137 [00:23<01:20, 111.45it/s] 19%|█▉ | 2141/11137 [00:23<01:20, 111.43it/s] 19%|█▉ | 2153/11137 [00:23<01:20, 111.51it/s] 19%|█▉ | 2165/11137 [00:23<01:20, 111.49it/s] 20%|█▉ | 2177/11137 [00:23<01:20, 111.52it/s] 20%|█▉ | 2189/11137 [00:23<01:20, 111.30it/s] 20%|█▉ | 2201/11137 [00:23<01:20, 110.65it/s] 20%|█▉ | 2213/11137 [00:24<01:20, 110.85it/s] 20%|█▉ | 2225/11137 [00:24<01:20, 111.06it/s] 20%|██ | 2237/11137 [00:24<01:20, 111.08it/s] 20%|██ | 2249/11137 [00:24<01:19, 111.22it/s] 20%|██ | 2261/11137 [00:24<01:19, 111.22it/s] 20%|██ | 2273/11137 [00:24<01:19, 111.33it/s] 21%|██ | 2285/11137 [00:24<01:19, 111.29it/s] 21%|██ | 2297/11137 [00:24<01:19, 111.20it/s] 21%|██ | 2309/11137 [00:24<01:19, 111.26it/s] 21%|██ | 2321/11137 [00:25<01:19, 111.36it/s] 21%|██ | 2333/11137 [00:25<01:18, 111.49it/s] 21%|██ | 2345/11137 [00:25<01:18, 111.44it/s] 21%|██ | 2357/11137 [00:25<01:19, 110.87it/s] 21%|██▏ | 2369/11137 [00:25<01:18, 111.27it/s] 21%|██▏ | 2381/11137 [00:25<01:18, 111.27it/s] 21%|██▏ | 2393/11137 [00:25<01:18, 111.27it/s] 22%|██▏ | 2405/11137 [00:25<01:18, 111.21it/s] 22%|██▏ | 2417/11137 [00:25<01:18, 111.25it/s] 22%|██▏ | 2429/11137 [00:26<01:18, 111.26it/s] 22%|██▏ | 2441/11137 [00:26<01:18, 111.16it/s] 22%|██▏ | 2453/11137 [00:26<01:17, 111.34it/s] 22%|██▏ | 2465/11137 [00:26<01:17, 111.44it/s] 22%|██▏ | 2477/11137 [00:26<01:17, 111.23it/s] 22%|██▏ | 2489/11137 [00:26<01:17, 111.35it/s] 22%|██▏ | 2501/11137 [00:26<01:18, 110.61it/s] 23%|██▎ | 2513/11137 [00:26<01:17, 110.88it/s] 23%|██▎ | 2525/11137 [00:26<01:17, 111.01it/s] 23%|██▎ | 2537/11137 [00:26<01:17, 111.25it/s] 23%|██▎ | 2549/11137 [00:27<01:17, 111.28it/s] 23%|██▎ | 2561/11137 [00:27<01:17, 111.21it/s] 23%|██▎ | 2573/11137 [00:27<01:17, 111.17it/s] 23%|██▎ | 2585/11137 [00:27<01:18, 108.81it/s] 23%|██▎ | 2597/11137 [00:27<01:18, 109.47it/s] 23%|██▎ | 2609/11137 [00:27<01:17, 110.07it/s] 24%|██▎ | 2621/11137 [00:27<01:17, 110.56it/s] 24%|██▎ | 2633/11137 [00:27<01:16, 110.72it/s] 24%|██▎ | 2645/11137 [00:27<01:17, 110.13it/s] 24%|██▍ | 2657/11137 [00:28<01:16, 110.58it/s] 24%|██▍ | 2669/11137 [00:28<01:16, 110.97it/s] 24%|██▍ | 2681/11137 [00:28<01:16, 111.18it/s] 24%|██▍ | 2693/11137 [00:28<01:15, 111.35it/s] 24%|██▍ | 2705/11137 [00:28<01:15, 111.24it/s] 24%|██▍ | 2717/11137 [00:28<01:15, 111.19it/s] 25%|██▍ | 2729/11137 [00:28<01:15, 111.32it/s] 25%|██▍ | 2741/11137 [00:28<01:15, 111.30it/s] 25%|██▍ | 2753/11137 [00:28<01:15, 111.13it/s] 25%|██▍ | 2765/11137 [00:29<01:15, 111.13it/s] 25%|██▍ | 2777/11137 [00:29<01:15, 111.40it/s] 25%|██▌ | 2789/11137 [00:29<01:14, 111.42it/s] 25%|██▌ | 2801/11137 [00:29<01:15, 110.78it/s] 25%|██▌ | 2813/11137 [00:29<01:15, 110.80it/s] 25%|██▌ | 2825/11137 [00:29<01:14, 111.03it/s] 25%|██▌ | 2837/11137 [00:29<01:14, 111.16it/s] 26%|██▌ | 2849/11137 [00:29<01:14, 111.36it/s] 26%|██▌ | 2861/11137 [00:29<01:14, 111.21it/s] 26%|██▌ | 2873/11137 [00:30<01:14, 111.33it/s] 26%|██▌ | 2885/11137 [00:30<01:14, 111.44it/s] 26%|██▌ | 2897/11137 [00:30<01:13, 111.39it/s] 26%|██▌ | 2909/11137 [00:30<01:13, 111.39it/s] 26%|██▌ | 2921/11137 [00:30<01:13, 111.41it/s] 26%|██▋ | 2933/11137 [00:30<01:13, 111.55it/s] 26%|██▋ | 2945/11137 [00:30<01:13, 110.97it/s] 27%|██▋ | 2957/11137 [00:30<01:13, 111.33it/s] 27%|██▋ | 2969/11137 [00:30<01:13, 111.52it/s] 27%|██▋ | 2981/11137 [00:30<01:13, 111.47it/s] 27%|██▋ | 2993/11137 [00:31<01:13, 111.42it/s] 27%|██▋ | 3005/11137 [00:31<01:12, 111.43it/s] 27%|██▋ | 3017/11137 [00:31<01:12, 111.44it/s] 27%|██▋ | 3029/11137 [00:31<01:12, 111.37it/s] 27%|██▋ | 3041/11137 [00:31<01:12, 111.35it/s] 27%|██▋ | 3053/11137 [00:31<01:12, 111.48it/s] 28%|██▊ | 3065/11137 [00:31<01:12, 111.54it/s] 28%|██▊ | 3077/11137 [00:31<01:12, 111.61it/s] 28%|██▊ | 3089/11137 [00:31<01:12, 111.68it/s] 28%|██▊ | 3101/11137 [00:32<01:12, 111.01it/s] 28%|██▊ | 3113/11137 [00:32<01:12, 111.12it/s] 28%|██▊ | 3125/11137 [00:32<01:11, 111.30it/s] 28%|██▊ | 3137/11137 [00:32<01:11, 111.31it/s] 28%|██▊ | 3149/11137 [00:32<01:11, 111.49it/s] 28%|██▊ | 3161/11137 [00:32<01:11, 111.46it/s] 28%|██▊ | 3173/11137 [00:32<01:11, 111.31it/s] 29%|██▊ | 3185/11137 [00:32<01:11, 111.48it/s] 29%|██▊ | 3197/11137 [00:32<01:11, 111.49it/s] 29%|██▉ | 3209/11137 [00:33<01:11, 111.59it/s] 29%|██▉ | 3221/11137 [00:33<01:11, 111.44it/s] 29%|██▉ | 3233/11137 [00:33<01:10, 111.62it/s] 29%|██▉ | 3245/11137 [00:33<01:11, 110.74it/s] 29%|██▉ | 3257/11137 [00:33<01:11, 110.98it/s] 29%|██▉ | 3269/11137 [00:33<01:10, 111.22it/s] 29%|██▉ | 3281/11137 [00:33<01:10, 111.32it/s] 30%|██▉ | 3293/11137 [00:33<01:10, 111.41it/s] 30%|██▉ | 3305/11137 [00:33<01:10, 111.47it/s] 30%|██▉ | 3317/11137 [00:34<01:10, 111.51it/s] 30%|██▉ | 3329/11137 [00:34<01:09, 111.58it/s] 30%|██▉ | 3341/11137 [00:34<01:09, 111.40it/s] 30%|███ | 3353/11137 [00:34<01:09, 111.37it/s] 30%|███ | 3365/11137 [00:34<01:09, 111.50it/s] 30%|███ | 3377/11137 [00:34<01:09, 111.45it/s] 30%|███ | 3389/11137 [00:34<01:09, 111.43it/s] 31%|███ | 3401/11137 [00:34<01:09, 110.69it/s] 31%|███ | 3413/11137 [00:34<01:09, 111.08it/s] 31%|███ | 3425/11137 [00:34<01:09, 111.06it/s] 31%|███ | 3437/11137 [00:35<01:09, 111.17it/s] 31%|███ | 3449/11137 [00:35<01:09, 111.25it/s] 31%|███ | 3461/11137 [00:35<01:09, 111.24it/s] 31%|███ | 3473/11137 [00:35<01:08, 111.30it/s] 31%|███▏ | 3485/11137 [00:35<01:08, 111.64it/s] 31%|███▏ | 3497/11137 [00:35<01:08, 111.65it/s] 32%|███▏ | 3509/11137 [00:35<01:08, 111.58it/s] 32%|███▏ | 3521/11137 [00:35<01:08, 111.65it/s] 32%|███▏ | 3533/11137 [00:35<01:08, 111.56it/s] 32%|███▏ | 3545/11137 [00:36<01:08, 110.81it/s] 32%|███▏ | 3557/11137 [00:36<01:08, 111.05it/s] 32%|███▏ | 3569/11137 [00:36<01:08, 111.19it/s] 32%|███▏ | 3581/11137 [00:36<01:07, 111.28it/s] 32%|███▏ | 3593/11137 [00:36<01:07, 111.15it/s] 32%|███▏ | 3605/11137 [00:36<01:07, 111.34it/s] 32%|███▏ | 3617/11137 [00:36<01:07, 111.24it/s] 33%|███▎ | 3629/11137 [00:36<01:07, 111.33it/s] 33%|███▎ | 3641/11137 [00:36<01:07, 111.38it/s] 33%|███▎ | 3653/11137 [00:37<01:07, 111.34it/s] 33%|███▎ | 3665/11137 [00:37<01:07, 111.39it/s] 33%|███▎ | 3677/11137 [00:37<01:06, 111.48it/s] 33%|███▎ | 3689/11137 [00:37<01:06, 111.42it/s] 33%|███▎ | 3701/11137 [00:37<01:07, 110.77it/s] 33%|███▎ | 3713/11137 [00:37<01:06, 110.95it/s] 33%|███▎ | 3725/11137 [00:37<01:06, 110.94it/s] 34%|███▎ | 3737/11137 [00:37<01:06, 111.17it/s] 34%|███▎ | 3749/11137 [00:37<01:06, 111.19it/s] 34%|███▍ | 3761/11137 [00:38<01:06, 111.41it/s] 34%|███▍ | 3773/11137 [00:38<01:06, 111.30it/s] 34%|███▍ | 3785/11137 [00:38<01:05, 111.43it/s] 34%|███▍ | 3797/11137 [00:38<01:05, 111.48it/s] 34%|███▍ | 3809/11137 [00:38<01:05, 111.39it/s] 34%|███▍ | 3821/11137 [00:38<01:05, 111.38it/s] 34%|███▍ | 3833/11137 [00:38<01:05, 111.45it/s] 35%|███▍ | 3845/11137 [00:38<01:05, 110.57it/s] 35%|███▍ | 3857/11137 [00:38<01:05, 110.83it/s] 35%|███▍ | 3869/11137 [00:38<01:05, 111.14it/s] 35%|███▍ | 3881/11137 [00:39<01:05, 111.41it/s] 35%|███▍ | 3893/11137 [00:39<01:05, 111.19it/s] 35%|███▌ | 3905/11137 [00:39<01:04, 111.35it/s] 35%|███▌ | 3917/11137 [00:39<01:04, 111.48it/s] 35%|███▌ | 3929/11137 [00:39<01:04, 111.71it/s] 35%|███▌ | 3941/11137 [00:39<01:04, 111.48it/s] 35%|███▌ | 3953/11137 [00:39<01:04, 111.44it/s] 36%|███▌ | 3965/11137 [00:39<01:04, 111.36it/s] 36%|███▌ | 3977/11137 [00:39<01:04, 111.44it/s] 36%|███▌ | 3989/11137 [00:40<01:04, 110.72it/s] 36%|███▌ | 4001/11137 [00:40<01:04, 111.03it/s] 36%|███▌ | 4013/11137 [00:40<01:03, 111.40it/s] 36%|███▌ | 4025/11137 [00:40<01:03, 111.33it/s] 36%|███▌ | 4037/11137 [00:40<01:03, 111.37it/s] 36%|███▋ | 4049/11137 [00:40<01:03, 111.28it/s] 36%|███▋ | 4061/11137 [00:40<01:03, 111.28it/s] 37%|███▋ | 4073/11137 [00:40<01:03, 111.20it/s] 37%|███▋ | 4085/11137 [00:40<01:03, 111.25it/s] 37%|███▋ | 4097/11137 [00:41<01:03, 111.14it/s] 37%|███▋ | 4109/11137 [00:41<01:03, 111.21it/s] 37%|███▋ | 4121/11137 [00:41<01:03, 111.16it/s] 37%|███▋ | 4133/11137 [00:41<01:02, 111.29it/s] 37%|███▋ | 4145/11137 [00:41<01:03, 110.65it/s] 37%|███▋ | 4157/11137 [00:41<01:02, 110.99it/s] 37%|███▋ | 4169/11137 [00:41<01:02, 111.03it/s] 38%|███▊ | 4181/11137 [00:41<01:02, 110.89it/s] 38%|███▊ | 4193/11137 [00:41<01:02, 111.05it/s] 38%|███▊ | 4205/11137 [00:41<01:02, 111.16it/s] 38%|███▊ | 4217/11137 [00:42<01:02, 111.10it/s] 38%|███▊ | 4229/11137 [00:42<01:02, 111.27it/s] 38%|███▊ | 4241/11137 [00:42<01:01, 111.39it/s] 38%|███▊ | 4253/11137 [00:42<01:01, 111.50it/s] 38%|███▊ | 4265/11137 [00:42<01:01, 111.58it/s] 38%|███▊ | 4277/11137 [00:42<01:01, 111.52it/s] 39%|███▊ | 4289/11137 [00:42<01:01, 110.80it/s] 39%|███▊ | 4301/11137 [00:42<01:01, 111.03it/s] 39%|███▊ | 4313/11137 [00:42<01:01, 111.14it/s] 39%|███▉ | 4325/11137 [00:43<01:01, 111.45it/s] 39%|███▉ | 4337/11137 [00:43<01:01, 111.42it/s] 39%|███▉ | 4349/11137 [00:43<01:00, 111.48it/s] 39%|███▉ | 4361/11137 [00:43<01:00, 111.35it/s] 39%|███▉ | 4373/11137 [00:43<01:00, 111.43it/s] 39%|███▉ | 4385/11137 [00:43<01:00, 111.43it/s] 39%|███▉ | 4397/11137 [00:43<01:00, 111.36it/s] 40%|███▉ | 4409/11137 [00:43<01:00, 111.31it/s] 40%|███▉ | 4421/11137 [00:43<01:00, 111.31it/s] 40%|███▉ | 4433/11137 [00:44<01:00, 111.24it/s] 40%|███▉ | 4445/11137 [00:44<01:00, 110.43it/s] 40%|████ | 4457/11137 [00:44<01:00, 110.79it/s] 40%|████ | 4469/11137 [00:44<01:00, 111.12it/s] 40%|████ | 4481/11137 [00:44<00:59, 111.31it/s] 40%|████ | 4493/11137 [00:44<00:59, 111.33it/s] 40%|████ | 4505/11137 [00:44<00:59, 111.26it/s] 41%|████ | 4517/11137 [00:44<00:59, 111.35it/s] 41%|████ | 4529/11137 [00:44<00:59, 111.22it/s] 41%|████ | 4541/11137 [00:45<00:59, 111.34it/s] 41%|████ | 4553/11137 [00:45<00:59, 111.33it/s] 41%|████ | 4565/11137 [00:45<00:59, 111.39it/s] 41%|████ | 4577/11137 [00:45<00:58, 111.27it/s] 41%|████ | 4589/11137 [00:45<00:59, 110.55it/s] 41%|████▏ | 4601/11137 [00:45<00:58, 110.83it/s] 41%|████▏ | 4613/11137 [00:45<00:58, 110.90it/s] 42%|████▏ | 4625/11137 [00:45<00:58, 111.05it/s] 42%|████▏ | 4637/11137 [00:45<00:58, 111.16it/s] 42%|████▏ | 4649/11137 [00:45<00:58, 111.27it/s] 42%|████▏ | 4661/11137 [00:46<00:59, 108.92it/s] 42%|████▏ | 4673/11137 [00:46<00:58, 109.70it/s] 42%|████▏ | 4685/11137 [00:46<00:58, 110.27it/s] 42%|████▏ | 4697/11137 [00:46<00:58, 110.58it/s] 42%|████▏ | 4709/11137 [00:46<00:58, 110.82it/s] 42%|████▏ | 4721/11137 [00:46<00:57, 110.77it/s] 42%|████▏ | 4733/11137 [00:46<00:58, 110.20it/s] 43%|████▎ | 4745/11137 [00:46<00:57, 110.61it/s] 43%|████▎ | 4757/11137 [00:46<00:57, 111.02it/s] 43%|████▎ | 4769/11137 [00:47<00:57, 111.24it/s] 43%|████▎ | 4781/11137 [00:47<00:57, 111.26it/s] 43%|████▎ | 4793/11137 [00:47<00:56, 111.44it/s] 43%|████▎ | 4805/11137 [00:47<00:56, 111.40it/s] 43%|████▎ | 4817/11137 [00:47<00:56, 111.46it/s] 43%|████▎ | 4829/11137 [00:47<00:56, 111.52it/s] 43%|████▎ | 4841/11137 [00:47<00:56, 111.44it/s] 44%|████▎ | 4853/11137 [00:47<00:56, 111.41it/s] 44%|████▎ | 4865/11137 [00:47<00:56, 111.55it/s] 44%|████▍ | 4877/11137 [00:48<00:56, 111.60it/s] 44%|████▍ | 4889/11137 [00:48<00:56, 110.84it/s] 44%|████▍ | 4901/11137 [00:48<00:56, 111.00it/s] 44%|████▍ | 4913/11137 [00:48<00:56, 111.09it/s] 44%|████▍ | 4925/11137 [00:48<00:55, 111.25it/s] 44%|████▍ | 4937/11137 [00:48<00:55, 111.29it/s] 44%|████▍ | 4949/11137 [00:48<00:55, 111.44it/s] 45%|████▍ | 4961/11137 [00:48<00:55, 111.41it/s] 45%|████▍ | 4973/11137 [00:48<00:55, 111.53it/s] 45%|████▍ | 4985/11137 [00:49<00:55, 111.57it/s] 45%|████▍ | 4997/11137 [00:49<00:55, 111.54it/s] 45%|████▍ | 5009/11137 [00:49<00:54, 111.54it/s] 45%|████▌ | 5021/11137 [00:49<00:54, 111.57it/s] 45%|████▌ | 5033/11137 [00:49<00:55, 110.91it/s] 45%|████▌ | 5045/11137 [00:49<00:54, 111.12it/s] 45%|████▌ | 5057/11137 [00:49<00:54, 111.23it/s] 46%|████▌ | 5069/11137 [00:49<00:54, 111.41it/s] 46%|████▌ | 5081/11137 [00:49<00:54, 111.40it/s] 46%|████▌ | 5093/11137 [00:49<00:54, 111.26it/s] 46%|████▌ | 5105/11137 [00:50<00:54, 111.28it/s] 46%|████▌ | 5117/11137 [00:50<00:54, 111.32it/s] 46%|████▌ | 5129/11137 [00:50<00:53, 111.45it/s] 46%|████▌ | 5141/11137 [00:50<00:53, 111.60it/s] 46%|████▋ | 5153/11137 [00:50<00:53, 111.32it/s] 46%|████▋ | 5165/11137 [00:50<00:53, 111.33it/s] 46%|████▋ | 5177/11137 [00:50<00:53, 111.43it/s] 47%|████▋ | 5189/11137 [00:50<00:53, 110.75it/s] 47%|████▋ | 5201/11137 [00:50<00:53, 111.07it/s] 47%|████▋ | 5213/11137 [00:51<00:53, 111.05it/s] 47%|████▋ | 5225/11137 [00:51<00:53, 111.12it/s] 47%|████▋ | 5237/11137 [00:51<00:53, 111.16it/s] 47%|████▋ | 5249/11137 [00:51<00:52, 111.42it/s] 47%|████▋ | 5261/11137 [00:51<00:52, 111.39it/s] 47%|████▋ | 5273/11137 [00:51<00:52, 111.51it/s] 47%|████▋ | 5285/11137 [00:51<00:52, 111.37it/s] 48%|████▊ | 5297/11137 [00:51<00:52, 111.42it/s] 48%|████▊ | 5309/11137 [00:51<00:52, 111.33it/s] 48%|████▊ | 5321/11137 [00:52<00:52, 111.30it/s] 48%|████▊ | 5333/11137 [00:52<00:52, 110.51it/s] 48%|████▊ | 5345/11137 [00:52<00:52, 110.89it/s] 48%|████▊ | 5357/11137 [00:52<00:52, 110.97it/s] 48%|████▊ | 5369/11137 [00:52<00:51, 111.06it/s] 48%|████▊ | 5381/11137 [00:52<00:51, 111.30it/s] 48%|████▊ | 5393/11137 [00:52<00:51, 111.16it/s] 49%|████▊ | 5405/11137 [00:52<00:51, 111.34it/s] 49%|████▊ | 5417/11137 [00:52<00:51, 111.55it/s] 49%|████▊ | 5429/11137 [00:53<00:51, 111.63it/s] 49%|████▉ | 5441/11137 [00:53<00:51, 111.54it/s] 49%|████▉ | 5453/11137 [00:53<00:50, 111.50it/s] 49%|████▉ | 5465/11137 [00:53<00:50, 111.53it/s] 49%|████▉ | 5477/11137 [00:53<00:50, 111.64it/s] 49%|████▉ | 5489/11137 [00:53<00:50, 110.97it/s] 49%|████▉ | 5501/11137 [00:53<00:50, 111.15it/s] 50%|████▉ | 5513/11137 [00:53<00:50, 111.11it/s] 50%|████▉ | 5525/11137 [00:53<00:50, 111.19it/s] 50%|████▉ | 5537/11137 [00:53<00:50, 111.17it/s] 50%|████▉ | 5549/11137 [00:54<00:50, 111.21it/s] 50%|████▉ | 5561/11137 [00:54<00:50, 111.28it/s] 50%|█████ | 5573/11137 [00:54<00:49, 111.29it/s] 50%|█████ | 5585/11137 [00:54<00:49, 111.39it/s] 50%|█████ | 5597/11137 [00:54<00:49, 111.35it/s] 50%|█████ | 5609/11137 [00:54<00:49, 111.44it/s] 50%|█████ | 5621/11137 [00:54<00:49, 111.52it/s] 51%|█████ | 5633/11137 [00:54<00:49, 110.88it/s] 51%|█████ | 5645/11137 [00:54<00:49, 111.22it/s] 51%|█████ | 5657/11137 [00:55<00:49, 111.38it/s] 51%|█████ | 5669/11137 [00:55<00:49, 111.25it/s] 51%|█████ | 5681/11137 [00:55<00:49, 111.31it/s] 51%|█████ | 5693/11137 [00:55<00:48, 111.36it/s] 51%|█████ | 5705/11137 [00:55<00:48, 111.37it/s] 51%|█████▏ | 5717/11137 [00:55<00:48, 111.33it/s] 51%|█████▏ | 5729/11137 [00:55<00:48, 111.55it/s] 52%|█████▏ | 5741/11137 [00:55<00:48, 111.49it/s] 52%|█████▏ | 5753/11137 [00:55<00:48, 111.35it/s] 52%|█████▏ | 5765/11137 [00:56<00:48, 111.43it/s] 52%|█████▏ | 5777/11137 [00:56<00:48, 111.43it/s] 52%|█████▏ | 5789/11137 [00:56<00:48, 110.78it/s] 52%|█████▏ | 5801/11137 [00:56<00:48, 110.89it/s] 52%|█████▏ | 5813/11137 [00:56<00:47, 111.06it/s] 52%|█████▏ | 5825/11137 [00:56<00:47, 111.14it/s] 52%|█████▏ | 5837/11137 [00:56<00:47, 111.14it/s] 53%|█████▎ | 5849/11137 [00:56<00:47, 111.23it/s] 53%|█████▎ | 5861/11137 [00:56<00:47, 111.39it/s] 53%|█████▎ | 5873/11137 [00:56<00:47, 111.59it/s] 53%|█████▎ | 5885/11137 [00:57<00:47, 111.45it/s] 53%|█████▎ | 5897/11137 [00:57<00:47, 111.26it/s] 53%|█████▎ | 5909/11137 [00:57<00:46, 111.28it/s] 53%|█████▎ | 5921/11137 [00:57<00:46, 111.38it/s] 53%|█████▎ | 5933/11137 [00:57<00:47, 110.59it/s] 53%|█████▎ | 5945/11137 [00:57<00:46, 110.84it/s] 53%|█████▎ | 5957/11137 [00:57<00:46, 110.85it/s] 54%|█████▎ | 5969/11137 [00:57<00:46, 111.02it/s] 54%|█████▎ | 5981/11137 [00:57<00:46, 111.14it/s] 54%|█████▍ | 5993/11137 [00:58<00:46, 111.17it/s] 54%|█████▍ | 6005/11137 [00:58<00:46, 111.26it/s] 54%|█████▍ | 6017/11137 [00:58<00:45, 111.35it/s] 54%|█████▍ | 6029/11137 [00:58<00:45, 111.26it/s] 54%|█████▍ | 6041/11137 [00:58<00:45, 111.19it/s] 54%|█████▍ | 6053/11137 [00:58<00:45, 111.13it/s] 54%|█████▍ | 6065/11137 [00:58<00:45, 111.22it/s] 55%|█████▍ | 6077/11137 [00:58<00:45, 110.66it/s] 55%|█████▍ | 6089/11137 [00:58<00:45, 110.94it/s] 55%|█████▍ | 6101/11137 [00:59<00:45, 111.05it/s] 55%|█████▍ | 6113/11137 [00:59<00:45, 111.15it/s] 55%|█████▍ | 6125/11137 [00:59<00:45, 111.24it/s] 55%|█████▌ | 6137/11137 [00:59<00:44, 111.37it/s] 55%|█████▌ | 6149/11137 [00:59<00:44, 111.41it/s] 55%|█████▌ | 6161/11137 [00:59<00:44, 111.43it/s] 55%|█████▌ | 6173/11137 [00:59<00:44, 111.45it/s] 56%|█████▌ | 6185/11137 [00:59<00:44, 111.57it/s] 56%|█████▌ | 6197/11137 [00:59<00:44, 111.75it/s] 56%|█████▌ | 6209/11137 [01:00<00:44, 111.61it/s] 56%|█████▌ | 6221/11137 [01:00<00:44, 111.46it/s] 56%|█████▌ | 6233/11137 [01:00<00:44, 110.75it/s] 56%|█████▌ | 6245/11137 [01:00<00:44, 111.01it/s] 56%|█████▌ | 6257/11137 [01:00<00:43, 111.21it/s] 56%|█████▋ | 6269/11137 [01:00<00:43, 111.16it/s] 56%|█████▋ | 6281/11137 [01:00<00:43, 111.20it/s] 57%|█████▋ | 6293/11137 [01:00<00:43, 111.29it/s] 57%|█████▋ | 6305/11137 [01:00<00:43, 111.33it/s] 57%|█████▋ | 6317/11137 [01:00<00:43, 111.45it/s] 57%|█████▋ | 6329/11137 [01:01<00:43, 111.49it/s] 57%|█████▋ | 6341/11137 [01:01<00:43, 111.44it/s] 57%|█████▋ | 6353/11137 [01:01<00:43, 111.06it/s] 57%|█████▋ | 6365/11137 [01:01<00:42, 111.17it/s] 57%|█████▋ | 6377/11137 [01:01<00:42, 110.72it/s] 57%|█████▋ | 6389/11137 [01:01<00:42, 110.74it/s] 57%|█████▋ | 6401/11137 [01:01<00:42, 110.96it/s] 58%|█████▊ | 6413/11137 [01:01<00:42, 111.07it/s] 58%|█████▊ | 6425/11137 [01:01<00:42, 111.14it/s] 58%|█████▊ | 6437/11137 [01:02<00:42, 111.23it/s] 58%|█████▊ | 6449/11137 [01:02<00:42, 111.31it/s] 58%|█████▊ | 6461/11137 [01:02<00:42, 111.32it/s] 58%|█████▊ | 6473/11137 [01:02<00:41, 111.22it/s] 58%|█████▊ | 6485/11137 [01:02<00:41, 111.35it/s] 58%|█████▊ | 6497/11137 [01:02<00:41, 111.19it/s] 58%|█████▊ | 6509/11137 [01:02<00:41, 111.32it/s] 59%|█████▊ | 6521/11137 [01:02<00:41, 111.45it/s] 59%|█████▊ | 6533/11137 [01:02<00:41, 110.63it/s] 59%|█████▉ | 6545/11137 [01:03<00:41, 110.79it/s] 59%|█████▉ | 6557/11137 [01:03<00:41, 110.95it/s] 59%|█████▉ | 6569/11137 [01:03<00:41, 111.20it/s] 59%|█████▉ | 6581/11137 [01:03<00:40, 111.24it/s] 59%|█████▉ | 6593/11137 [01:03<00:40, 111.31it/s] 59%|█████▉ | 6605/11137 [01:03<00:40, 111.16it/s] 59%|█████▉ | 6617/11137 [01:03<00:40, 111.19it/s] 60%|█████▉ | 6629/11137 [01:03<00:40, 111.19it/s] 60%|█████▉ | 6641/11137 [01:03<00:40, 111.26it/s] 60%|█████▉ | 6653/11137 [01:04<00:40, 111.38it/s] 60%|█████▉ | 6665/11137 [01:04<00:40, 111.52it/s] 60%|█████▉ | 6677/11137 [01:04<00:40, 110.71it/s] 60%|██████ | 6689/11137 [01:04<00:40, 110.94it/s] 60%|██████ | 6701/11137 [01:04<00:39, 111.19it/s] 60%|██████ | 6713/11137 [01:04<00:39, 111.18it/s] 60%|██████ | 6725/11137 [01:04<00:39, 111.20it/s] 60%|██████ | 6737/11137 [01:04<00:40, 108.84it/s] 61%|██████ | 6749/11137 [01:04<00:40, 109.60it/s] 61%|██████ | 6761/11137 [01:04<00:39, 110.28it/s] 61%|██████ | 6773/11137 [01:05<00:39, 110.61it/s] 61%|██████ | 6785/11137 [01:05<00:39, 110.83it/s] 61%|██████ | 6797/11137 [01:05<00:39, 111.00it/s] 61%|██████ | 6809/11137 [01:05<00:38, 111.09it/s] 61%|██████ | 6821/11137 [01:05<00:39, 110.37it/s] 61%|██████▏ | 6833/11137 [01:05<00:38, 110.68it/s] 61%|██████▏ | 6845/11137 [01:05<00:38, 110.84it/s] 62%|██████▏ | 6857/11137 [01:05<00:38, 111.06it/s] 62%|██████▏ | 6869/11137 [01:05<00:38, 111.23it/s] 62%|██████▏ | 6881/11137 [01:06<00:38, 111.32it/s] 62%|██████▏ | 6893/11137 [01:06<00:38, 111.60it/s] 62%|██████▏ | 6905/11137 [01:06<00:37, 111.64it/s] 62%|██████▏ | 6917/11137 [01:06<00:37, 111.74it/s] 62%|██████▏ | 6929/11137 [01:06<00:37, 111.74it/s] 62%|██████▏ | 6941/11137 [01:06<00:37, 111.76it/s] 62%|██████▏ | 6953/11137 [01:06<00:37, 111.63it/s] 63%|██████▎ | 6965/11137 [01:06<00:37, 111.58it/s] 63%|██████▎ | 6977/11137 [01:06<00:37, 110.85it/s] 63%|██████▎ | 6989/11137 [01:07<00:37, 110.88it/s] 63%|██████▎ | 7001/11137 [01:07<00:37, 111.13it/s] 63%|██████▎ | 7013/11137 [01:07<00:37, 111.23it/s] 63%|██████▎ | 7025/11137 [01:07<00:36, 111.27it/s] 63%|██████▎ | 7037/11137 [01:07<00:36, 111.21it/s] 63%|██████▎ | 7049/11137 [01:07<00:36, 111.22it/s] 63%|██████▎ | 7061/11137 [01:07<00:36, 111.12it/s] 64%|██████▎ | 7073/11137 [01:07<00:36, 111.16it/s] 64%|██████▎ | 7085/11137 [01:07<00:36, 111.12it/s] 64%|██████▎ | 7097/11137 [01:08<00:36, 111.20it/s] 64%|██████▍ | 7109/11137 [01:08<00:36, 111.22it/s] 64%|██████▍ | 7121/11137 [01:08<00:36, 110.63it/s] 64%|██████▍ | 7133/11137 [01:08<00:36, 110.90it/s] 64%|██████▍ | 7145/11137 [01:08<00:35, 110.94it/s] 64%|██████▍ | 7157/11137 [01:08<00:35, 111.01it/s] 64%|██████▍ | 7169/11137 [01:08<00:35, 111.10it/s] 64%|██████▍ | 7181/11137 [01:08<00:35, 111.29it/s] 65%|██████▍ | 7193/11137 [01:08<00:35, 111.49it/s] 65%|██████▍ | 7205/11137 [01:08<00:35, 111.49it/s] 65%|██████▍ | 7217/11137 [01:09<00:35, 111.56it/s] 65%|██████▍ | 7229/11137 [01:09<00:35, 111.53it/s] 65%|██████▌ | 7241/11137 [01:09<00:34, 111.61it/s] 65%|██████▌ | 7253/11137 [01:09<00:34, 111.53it/s] 65%|██████▌ | 7265/11137 [01:09<00:34, 111.53it/s] 65%|██████▌ | 7277/11137 [01:09<00:34, 110.65it/s] 65%|██████▌ | 7289/11137 [01:09<00:34, 110.79it/s] 66%|██████▌ | 7301/11137 [01:09<00:34, 110.99it/s] 66%|██████▌ | 7313/11137 [01:09<00:34, 111.08it/s] 66%|██████▌ | 7325/11137 [01:10<00:34, 111.34it/s] 66%|██████▌ | 7337/11137 [01:10<00:34, 111.19it/s] 66%|██████▌ | 7349/11137 [01:10<00:34, 111.15it/s] 66%|██████▌ | 7361/11137 [01:10<00:33, 111.29it/s] 66%|██████▌ | 7373/11137 [01:10<00:33, 111.33it/s] 66%|██████▋ | 7385/11137 [01:10<00:33, 111.43it/s] 66%|██████▋ | 7397/11137 [01:10<00:33, 111.36it/s] 67%|██████▋ | 7409/11137 [01:10<00:33, 111.34it/s] 67%|██████▋ | 7421/11137 [01:10<00:33, 110.61it/s] 67%|██████▋ | 7433/11137 [01:11<00:33, 110.89it/s] 67%|██████▋ | 7445/11137 [01:11<00:33, 111.25it/s] 67%|██████▋ | 7457/11137 [01:11<00:33, 111.22it/s] 67%|██████▋ | 7469/11137 [01:11<00:32, 111.19it/s] 67%|██████▋ | 7481/11137 [01:11<00:32, 111.21it/s] 67%|██████▋ | 7493/11137 [01:11<00:32, 111.53it/s] 67%|██████▋ | 7505/11137 [01:11<00:32, 111.35it/s] 67%|██████▋ | 7517/11137 [01:11<00:32, 111.29it/s] 68%|██████▊ | 7529/11137 [01:11<00:32, 111.42it/s] 68%|██████▊ | 7541/11137 [01:12<00:32, 111.45it/s] 68%|██████▊ | 7553/11137 [01:12<00:32, 111.27it/s] 68%|██████▊ | 7565/11137 [01:12<00:32, 111.55it/s] 68%|██████▊ | 7577/11137 [01:12<00:32, 110.71it/s] 68%|██████▊ | 7589/11137 [01:12<00:32, 110.86it/s] 68%|██████▊ | 7601/11137 [01:12<00:31, 111.06it/s] 68%|██████▊ | 7613/11137 [01:12<00:31, 111.16it/s] 68%|██████▊ | 7625/11137 [01:12<00:31, 111.36it/s] 69%|██████▊ | 7637/11137 [01:12<00:31, 111.36it/s] 69%|██████▊ | 7649/11137 [01:12<00:31, 111.36it/s] 69%|██████▉ | 7661/11137 [01:13<00:31, 111.28it/s] 69%|██████▉ | 7673/11137 [01:13<00:31, 111.46it/s] 69%|██████▉ | 7685/11137 [01:13<00:30, 111.41it/s] 69%|██████▉ | 7697/11137 [01:13<00:30, 111.45it/s] 69%|██████▉ | 7709/11137 [01:13<00:30, 111.53it/s] 69%|██████▉ | 7721/11137 [01:13<00:30, 110.77it/s] 69%|██████▉ | 7733/11137 [01:13<00:30, 111.13it/s] 70%|██████▉ | 7745/11137 [01:13<00:30, 111.29it/s] 70%|██████▉ | 7757/11137 [01:13<00:30, 111.45it/s] 70%|██████▉ | 7769/11137 [01:14<00:30, 111.46it/s] 70%|██████▉ | 7781/11137 [01:14<00:30, 111.42it/s] 70%|██████▉ | 7793/11137 [01:14<00:30, 111.45it/s] 70%|███████ | 7805/11137 [01:14<00:29, 111.62it/s] 70%|███████ | 7817/11137 [01:14<00:29, 111.63it/s] 70%|███████ | 7829/11137 [01:14<00:29, 111.63it/s] 70%|███████ | 7841/11137 [01:14<00:29, 111.47it/s] 71%|███████ | 7853/11137 [01:14<00:29, 111.44it/s] 71%|███████ | 7865/11137 [01:14<00:29, 111.43it/s] 71%|███████ | 7877/11137 [01:15<00:29, 110.67it/s] 71%|███████ | 7889/11137 [01:15<00:29, 110.87it/s] 71%|███████ | 7901/11137 [01:15<00:29, 111.11it/s] 71%|███████ | 7913/11137 [01:15<00:28, 111.24it/s] 71%|███████ | 7925/11137 [01:15<00:28, 111.44it/s] 71%|███████▏ | 7937/11137 [01:15<00:28, 111.46it/s] 71%|███████▏ | 7949/11137 [01:15<00:28, 111.45it/s] 71%|███████▏ | 7961/11137 [01:15<00:28, 111.36it/s] 72%|███████▏ | 7973/11137 [01:15<00:28, 111.46it/s] 72%|███████▏ | 7985/11137 [01:15<00:28, 111.40it/s] 72%|███████▏ | 7997/11137 [01:16<00:28, 111.39it/s] 72%|███████▏ | 8009/11137 [01:16<00:28, 111.49it/s] 72%|███████▏ | 8021/11137 [01:16<00:28, 110.64it/s] 72%|███████▏ | 8033/11137 [01:16<00:28, 110.82it/s] 72%|███████▏ | 8045/11137 [01:16<00:27, 110.99it/s] 72%|███████▏ | 8057/11137 [01:16<00:27, 111.09it/s] 72%|███████▏ | 8069/11137 [01:16<00:27, 111.02it/s] 73%|███████▎ | 8081/11137 [01:16<00:27, 110.92it/s] 73%|███████▎ | 8093/11137 [01:16<00:27, 110.99it/s] 73%|███████▎ | 8105/11137 [01:17<00:27, 111.24it/s] 73%|███████▎ | 8117/11137 [01:17<00:27, 111.06it/s] 73%|███████▎ | 8129/11137 [01:17<00:27, 111.07it/s] 73%|███████▎ | 8141/11137 [01:17<00:26, 111.35it/s] 73%|███████▎ | 8153/11137 [01:17<00:26, 111.39it/s] 73%|███████▎ | 8165/11137 [01:17<00:26, 110.67it/s] 73%|███████▎ | 8177/11137 [01:17<00:26, 110.90it/s] 74%|███████▎ | 8189/11137 [01:17<00:26, 111.14it/s] 74%|███████▎ | 8201/11137 [01:17<00:26, 111.32it/s] 74%|███████▎ | 8213/11137 [01:18<00:26, 111.36it/s] 74%|███████▍ | 8225/11137 [01:18<00:26, 111.33it/s] 74%|███████▍ | 8237/11137 [01:18<00:26, 111.32it/s] 74%|███████▍ | 8249/11137 [01:18<00:25, 111.35it/s] 74%|███████▍ | 8261/11137 [01:18<00:25, 111.41it/s] 74%|███████▍ | 8273/11137 [01:18<00:25, 111.49it/s] 74%|███████▍ | 8285/11137 [01:18<00:25, 111.36it/s] 74%|███████▍ | 8297/11137 [01:18<00:25, 111.29it/s] 75%|███████▍ | 8309/11137 [01:18<00:25, 111.28it/s] 75%|███████▍ | 8321/11137 [01:19<00:25, 110.65it/s] 75%|███████▍ | 8333/11137 [01:19<00:25, 111.14it/s] 75%|███████▍ | 8345/11137 [01:19<00:25, 111.27it/s] 75%|███████▌ | 8357/11137 [01:19<00:24, 111.30it/s] 75%|███████▌ | 8369/11137 [01:19<00:24, 111.25it/s] 75%|███████▌ | 8381/11137 [01:19<00:24, 111.22it/s] 75%|███████▌ | 8393/11137 [01:19<00:24, 111.42it/s] 75%|███████▌ | 8405/11137 [01:19<00:24, 111.28it/s] 76%|███████▌ | 8417/11137 [01:19<00:24, 111.28it/s] 76%|███████▌ | 8429/11137 [01:19<00:24, 111.07it/s] 76%|███████▌ | 8441/11137 [01:20<00:24, 111.19it/s] 76%|███████▌ | 8453/11137 [01:20<00:24, 111.20it/s] 76%|███████▌ | 8465/11137 [01:20<00:24, 110.74it/s] 76%|███████▌ | 8477/11137 [01:20<00:23, 110.91it/s] 76%|███████▌ | 8489/11137 [01:20<00:23, 111.01it/s] 76%|███████▋ | 8501/11137 [01:20<00:23, 111.13it/s] 76%|███████▋ | 8513/11137 [01:20<00:23, 111.23it/s] 77%|███████▋ | 8525/11137 [01:20<00:23, 111.42it/s] 77%|███████▋ | 8537/11137 [01:20<00:23, 111.36it/s] 77%|███████▋ | 8549/11137 [01:21<00:23, 111.45it/s] 77%|███████▋ | 8561/11137 [01:21<00:23, 111.54it/s] 77%|███████▋ | 8573/11137 [01:21<00:22, 111.55it/s] 77%|███████▋ | 8585/11137 [01:21<00:22, 111.58it/s] 77%|███████▋ | 8597/11137 [01:21<00:22, 111.62it/s] 77%|███████▋ | 8609/11137 [01:21<00:22, 111.46it/s] 77%|███████▋ | 8621/11137 [01:21<00:22, 110.77it/s] 78%|███████▊ | 8633/11137 [01:21<00:22, 111.18it/s] 78%|███████▊ | 8645/11137 [01:21<00:22, 111.31it/s] 78%|███████▊ | 8657/11137 [01:22<00:22, 111.18it/s] 78%|███████▊ | 8669/11137 [01:22<00:22, 111.19it/s] 78%|███████▊ | 8681/11137 [01:22<00:22, 111.34it/s] 78%|███████▊ | 8693/11137 [01:22<00:21, 111.27it/s] 78%|███████▊ | 8705/11137 [01:22<00:21, 111.23it/s] 78%|███████▊ | 8717/11137 [01:22<00:21, 111.48it/s] 78%|███████▊ | 8729/11137 [01:22<00:21, 111.32it/s] 78%|███████▊ | 8741/11137 [01:22<00:21, 111.39it/s] 79%|███████▊ | 8753/11137 [01:22<00:21, 111.46it/s] 79%|███████▊ | 8765/11137 [01:23<00:21, 110.78it/s] 79%|███████▉ | 8777/11137 [01:23<00:21, 110.90it/s] 79%|███████▉ | 8789/11137 [01:23<00:21, 111.15it/s] 79%|███████▉ | 8801/11137 [01:23<00:21, 111.03it/s] 79%|███████▉ | 8813/11137 [01:23<00:21, 108.84it/s] 79%|███████▉ | 8825/11137 [01:23<00:21, 109.69it/s] 79%|███████▉ | 8837/11137 [01:23<00:20, 110.29it/s] 79%|███████▉ | 8849/11137 [01:23<00:20, 110.71it/s] 80%|███████▉ | 8861/11137 [01:23<00:20, 110.82it/s] 80%|███████▉ | 8873/11137 [01:23<00:20, 111.09it/s] 80%|███████▉ | 8885/11137 [01:24<00:20, 111.21it/s] 80%|███████▉ | 8897/11137 [01:24<00:20, 111.40it/s] 80%|███████▉ | 8909/11137 [01:24<00:20, 110.80it/s] 80%|████████ | 8921/11137 [01:24<00:19, 111.04it/s] 80%|████████ | 8933/11137 [01:24<00:19, 111.34it/s] 80%|████████ | 8945/11137 [01:24<00:19, 111.45it/s] 80%|████████ | 8957/11137 [01:24<00:19, 111.46it/s] 81%|████████ | 8969/11137 [01:24<00:19, 111.45it/s] 81%|████████ | 8981/11137 [01:24<00:19, 111.62it/s] 81%|████████ | 8993/11137 [01:25<00:19, 111.57it/s] 81%|████████ | 9005/11137 [01:25<00:19, 111.44it/s] 81%|████████ | 9017/11137 [01:25<00:19, 111.34it/s] 81%|████████ | 9029/11137 [01:25<00:18, 111.45it/s] 81%|████████ | 9041/11137 [01:25<00:18, 111.40it/s] 81%|████████▏ | 9053/11137 [01:25<00:18, 111.49it/s] 81%|████████▏ | 9065/11137 [01:25<00:18, 110.85it/s] 82%|████████▏ | 9077/11137 [01:25<00:18, 110.97it/s] 82%|████████▏ | 9089/11137 [01:25<00:18, 111.22it/s] 82%|████████▏ | 9101/11137 [01:26<00:18, 111.20it/s] 82%|████████▏ | 9113/11137 [01:26<00:18, 111.41it/s] 82%|████████▏ | 9125/11137 [01:26<00:18, 111.55it/s] 82%|████████▏ | 9137/11137 [01:26<00:17, 111.44it/s] 82%|████████▏ | 9149/11137 [01:26<00:17, 111.35it/s] 82%|████████▏ | 9161/11137 [01:26<00:17, 111.32it/s] 82%|████████▏ | 9173/11137 [01:26<00:17, 111.40it/s] 82%|████████▏ | 9185/11137 [01:26<00:17, 111.40it/s] 83%|████████▎ | 9197/11137 [01:26<00:17, 111.44it/s] 83%|████████▎ | 9209/11137 [01:27<00:17, 110.73it/s] 83%|████████▎ | 9221/11137 [01:27<00:17, 110.98it/s] 83%|████████▎ | 9233/11137 [01:27<00:17, 111.10it/s] 83%|████████▎ | 9245/11137 [01:27<00:17, 111.07it/s] 83%|████████▎ | 9257/11137 [01:27<00:16, 111.26it/s] 83%|████████▎ | 9269/11137 [01:27<00:16, 111.17it/s] 83%|████████▎ | 9281/11137 [01:27<00:16, 111.33it/s] 83%|████████▎ | 9293/11137 [01:27<00:16, 111.24it/s] 84%|████████▎ | 9305/11137 [01:27<00:16, 111.36it/s] 84%|████████▎ | 9317/11137 [01:27<00:16, 111.46it/s] 84%|████████▍ | 9329/11137 [01:28<00:16, 111.37it/s] 84%|████████▍ | 9341/11137 [01:28<00:16, 111.22it/s] 84%|████████▍ | 9353/11137 [01:28<00:16, 111.35it/s] 84%|████████▍ | 9365/11137 [01:28<00:16, 110.59it/s] 84%|████████▍ | 9377/11137 [01:28<00:15, 110.89it/s] 84%|████████▍ | 9389/11137 [01:28<00:15, 111.01it/s] 84%|████████▍ | 9401/11137 [01:28<00:15, 111.09it/s] 85%|████████▍ | 9413/11137 [01:28<00:15, 111.22it/s] 85%|████████▍ | 9425/11137 [01:28<00:15, 111.20it/s] 85%|████████▍ | 9437/11137 [01:29<00:15, 111.13it/s] 85%|████████▍ | 9449/11137 [01:29<00:15, 111.14it/s] 85%|████████▍ | 9461/11137 [01:29<00:15, 111.12it/s] 85%|████████▌ | 9473/11137 [01:29<00:14, 111.19it/s] 85%|████████▌ | 9485/11137 [01:29<00:14, 111.02it/s] 85%|████████▌ | 9497/11137 [01:29<00:14, 111.16it/s] 85%|████████▌ | 9509/11137 [01:29<00:14, 110.44it/s] 85%|████████▌ | 9521/11137 [01:29<00:14, 110.80it/s] 86%|████████▌ | 9533/11137 [01:29<00:14, 110.90it/s] 86%|████████▌ | 9545/11137 [01:30<00:14, 111.14it/s] 86%|████████▌ | 9557/11137 [01:30<00:14, 111.40it/s] 86%|████████▌ | 9569/11137 [01:30<00:14, 111.44it/s] 86%|████████▌ | 9581/11137 [01:30<00:13, 111.41it/s] 86%|████████▌ | 9593/11137 [01:30<00:13, 111.31it/s] 86%|████████▌ | 9605/11137 [01:30<00:13, 111.37it/s] 86%|████████▋ | 9617/11137 [01:30<00:13, 111.49it/s] 86%|████████▋ | 9629/11137 [01:30<00:13, 111.47it/s] 87%|████████▋ | 9641/11137 [01:30<00:13, 111.49it/s] 87%|████████▋ | 9653/11137 [01:30<00:13, 111.65it/s] 87%|████████▋ | 9665/11137 [01:31<00:13, 110.71it/s] 87%|████████▋ | 9677/11137 [01:31<00:13, 110.87it/s] 87%|████████▋ | 9689/11137 [01:31<00:13, 110.93it/s] 87%|████████▋ | 9701/11137 [01:31<00:12, 111.02it/s] 87%|████████▋ | 9713/11137 [01:31<00:12, 111.22it/s] 87%|████████▋ | 9725/11137 [01:31<00:12, 111.40it/s] 87%|████████▋ | 9737/11137 [01:31<00:12, 111.45it/s] 88%|████████▊ | 9749/11137 [01:31<00:12, 111.53it/s] 88%|████████▊ | 9761/11137 [01:31<00:12, 111.59it/s] 88%|████████▊ | 9773/11137 [01:32<00:12, 111.59it/s] 88%|████████▊ | 9785/11137 [01:32<00:12, 111.53it/s] 88%|████████▊ | 9797/11137 [01:32<00:12, 111.52it/s] 88%|████████▊ | 9809/11137 [01:32<00:11, 110.69it/s] 88%|████████▊ | 9821/11137 [01:32<00:11, 110.88it/s] 88%|████████▊ | 9833/11137 [01:32<00:11, 111.14it/s] 88%|████████▊ | 9845/11137 [01:32<00:11, 111.09it/s] 89%|████████▊ | 9857/11137 [01:32<00:11, 111.13it/s] 89%|████████▊ | 9869/11137 [01:32<00:11, 111.08it/s] 89%|████████▊ | 9881/11137 [01:33<00:11, 111.13it/s] 89%|████████▉ | 9893/11137 [01:33<00:11, 111.22it/s] 89%|████████▉ | 9905/11137 [01:33<00:11, 111.26it/s] 89%|████████▉ | 9917/11137 [01:33<00:10, 111.40it/s] 89%|████████▉ | 9929/11137 [01:33<00:10, 111.33it/s] 89%|████████▉ | 9941/11137 [01:33<00:10, 111.55it/s] 89%|████████▉ | 9953/11137 [01:33<00:10, 110.89it/s] 89%|████████▉ | 9965/11137 [01:33<00:10, 111.01it/s] 90%|████████▉ | 9977/11137 [01:33<00:10, 111.29it/s] 90%|████████▉ | 9989/11137 [01:34<00:10, 111.20it/s] 90%|████████▉ | 10001/11137 [01:34<00:10, 111.28it/s] 90%|████████▉ | 10013/11137 [01:34<00:10, 111.46it/s] 90%|█████████ | 10025/11137 [01:34<00:09, 111.55it/s] 90%|█████████ | 10037/11137 [01:34<00:09, 111.41it/s] 90%|█████████ | 10049/11137 [01:34<00:09, 111.37it/s] 90%|█████████ | 10061/11137 [01:34<00:09, 111.45it/s] 90%|█████████ | 10073/11137 [01:34<00:09, 111.44it/s] 91%|█████████ | 10085/11137 [01:34<00:09, 111.38it/s] 91%|█████████ | 10097/11137 [01:34<00:09, 111.46it/s] 91%|█████████ | 10109/11137 [01:35<00:09, 110.89it/s] 91%|█████████ | 10121/11137 [01:35<00:09, 111.08it/s] 91%|█████████ | 10133/11137 [01:35<00:09, 111.17it/s] 91%|█████████ | 10145/11137 [01:35<00:08, 111.12it/s] 91%|█████████ | 10157/11137 [01:35<00:08, 111.22it/s] 91%|█████████▏| 10169/11137 [01:35<00:08, 111.38it/s] 91%|█████████▏| 10181/11137 [01:35<00:08, 111.30it/s] 92%|█████████▏| 10193/11137 [01:35<00:08, 111.31it/s] 92%|█████████▏| 10205/11137 [01:35<00:08, 111.31it/s] 92%|█████████▏| 10217/11137 [01:36<00:08, 111.37it/s] 92%|█████████▏| 10229/11137 [01:36<00:08, 111.42it/s] 92%|█████████▏| 10241/11137 [01:36<00:08, 111.49it/s] 92%|█████████▏| 10253/11137 [01:36<00:07, 110.79it/s] 92%|█████████▏| 10265/11137 [01:36<00:07, 111.00it/s] 92%|█████████▏| 10277/11137 [01:36<00:07, 111.06it/s] 92%|█████████▏| 10289/11137 [01:36<00:07, 111.12it/s] 92%|█████████▏| 10301/11137 [01:36<00:07, 111.21it/s] 93%|█████████▎| 10313/11137 [01:36<00:07, 111.46it/s] 93%|█████████▎| 10325/11137 [01:37<00:07, 111.45it/s] 93%|█████████▎| 10337/11137 [01:37<00:07, 111.48it/s] 93%|█████████▎| 10349/11137 [01:37<00:07, 111.61it/s] 93%|█████████▎| 10361/11137 [01:37<00:06, 111.56it/s] 93%|█████████▎| 10373/11137 [01:37<00:06, 111.46it/s] 93%|█████████▎| 10385/11137 [01:37<00:06, 111.29it/s] 93%|█████████▎| 10397/11137 [01:37<00:06, 111.20it/s] 93%|█████████▎| 10409/11137 [01:37<00:06, 110.42it/s] 94%|█████████▎| 10421/11137 [01:37<00:06, 110.68it/s] 94%|█████████▎| 10433/11137 [01:38<00:06, 110.86it/s] 94%|█████████▍| 10445/11137 [01:38<00:06, 111.00it/s] 94%|█████████▍| 10457/11137 [01:38<00:06, 111.16it/s] 94%|█████████▍| 10469/11137 [01:38<00:06, 111.01it/s] 94%|█████████▍| 10481/11137 [01:38<00:05, 111.16it/s] 94%|█████████▍| 10493/11137 [01:38<00:05, 111.26it/s] 94%|█████████▍| 10505/11137 [01:38<00:05, 111.35it/s] 94%|█████████▍| 10517/11137 [01:38<00:05, 111.40it/s] 95%|█████████▍| 10529/11137 [01:38<00:05, 111.40it/s] 95%|█████████▍| 10541/11137 [01:38<00:05, 111.45it/s] 95%|█████████▍| 10553/11137 [01:39<00:05, 110.75it/s] 95%|█████████▍| 10565/11137 [01:39<00:05, 111.02it/s] 95%|█████████▍| 10577/11137 [01:39<00:05, 111.05it/s] 95%|█████████▌| 10589/11137 [01:39<00:04, 111.28it/s] 95%|█████████▌| 10601/11137 [01:39<00:04, 111.31it/s] 95%|█████████▌| 10613/11137 [01:39<00:04, 111.33it/s] 95%|█████████▌| 10625/11137 [01:39<00:04, 111.23it/s] 96%|█████████▌| 10637/11137 [01:39<00:04, 111.50it/s] 96%|█████████▌| 10649/11137 [01:39<00:04, 111.45it/s] 96%|█████████▌| 10661/11137 [01:40<00:04, 111.58it/s] 96%|█████████▌| 10673/11137 [01:40<00:04, 111.56it/s] 96%|█████████▌| 10685/11137 [01:40<00:04, 111.46it/s] 96%|█████████▌| 10697/11137 [01:40<00:03, 111.36it/s] 96%|█████████▌| 10709/11137 [01:40<00:03, 110.69it/s] 96%|█████████▋| 10721/11137 [01:40<00:03, 110.92it/s] 96%|█████████▋| 10733/11137 [01:40<00:03, 110.92it/s] 96%|█████████▋| 10745/11137 [01:40<00:03, 111.01it/s] 97%|█████████▋| 10757/11137 [01:40<00:03, 111.18it/s] 97%|█████████▋| 10769/11137 [01:41<00:03, 111.33it/s] 97%|█████████▋| 10781/11137 [01:41<00:03, 111.29it/s] 97%|█████████▋| 10793/11137 [01:41<00:03, 111.25it/s] 97%|█████████▋| 10805/11137 [01:41<00:02, 111.39it/s] 97%|█████████▋| 10817/11137 [01:41<00:02, 111.28it/s] 97%|█████████▋| 10829/11137 [01:41<00:02, 111.25it/s] 97%|█████████▋| 10841/11137 [01:41<00:02, 111.38it/s] 97%|█████████▋| 10853/11137 [01:41<00:02, 110.74it/s] 98%|█████████▊| 10865/11137 [01:41<00:02, 110.90it/s] 98%|█████████▊| 10877/11137 [01:41<00:02, 111.16it/s] 98%|█████████▊| 10889/11137 [01:42<00:02, 108.72it/s] 98%|█████████▊| 10901/11137 [01:42<00:02, 109.52it/s] 98%|█████████▊| 10913/11137 [01:42<00:02, 110.06it/s] 98%|█████████▊| 10925/11137 [01:42<00:01, 110.55it/s] 98%|█████████▊| 10937/11137 [01:42<00:01, 110.71it/s] 98%|█████████▊| 10949/11137 [01:42<00:01, 111.07it/s] 98%|█████████▊| 10961/11137 [01:42<00:01, 111.05it/s] 99%|█████████▊| 10973/11137 [01:42<00:01, 111.18it/s] 99%|█████████▊| 10985/11137 [01:42<00:01, 111.09it/s] 99%|█████████▊| 10997/11137 [01:43<00:01, 110.40it/s] 99%|█████████▉| 11009/11137 [01:43<00:01, 110.79it/s] 99%|█████████▉| 11021/11137 [01:43<00:01, 110.94it/s] 99%|█████████▉| 11033/11137 [01:43<00:00, 111.32it/s] 99%|█████████▉| 11045/11137 [01:43<00:00, 111.43it/s] 99%|█████████▉| 11057/11137 [01:43<00:00, 111.36it/s] 99%|█████████▉| 11069/11137 [01:43<00:00, 111.28it/s] 99%|█████████▉| 11081/11137 [01:43<00:00, 111.48it/s] 100%|█████████▉| 11093/11137 [01:43<00:00, 111.44it/s] 100%|█████████▉| 11105/11137 [01:44<00:00, 111.30it/s] 100%|█████████▉| 11117/11137 [01:44<00:00, 111.42it/s] 100%|█████████▉| 11129/11137 [01:44<00:00, 111.40it/s] 100%|██████████| 11137/11137 [01:44<00:00, 106.74it/s]
INFO:TestAccuracy:Batch size is 1, F1: 83.15931, Exact Match:76.51971
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
INFO:BackendDCU:Batch size is 1, QPS: 118, Avg Latency:8.46, Tail Latency:8.85
INFO:BackendDCU:Batch size is 4, QPS: 164, Avg Latency:24.39, Tail Latency:26.91
INFO:BackendDCU:Batch size is 8, QPS: 201, Avg Latency:39.64, Tail Latency:41.97
INFO:BackendDCU:Batch size is 16, QPS: 214, Avg Latency:74.42, Tail Latency:76.45
INFO:BackendDCU:Batch size is 24, QPS: 224, Avg Latency:106.71, Tail Latency:108.92
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/roberta-torch-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/roberta-torch-fp32/ROBERTA-TORCH-FP32-TO-FP32.JSON.pdf ]
Writing predictions to: /home/workspace/ByteMLPerf/byte_infer_perf/general_perf/reports/DCU/predictions.json
ByteMLPerf/byte_infer_perf/general_perf/log/roformer-tf-fp32.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: roformer-tf-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: open_cail2019
INFO:CAIL2019:Initial...
INFO:CAIL2019:Preprocessing...
INFO:CAIL2019:Rebatching batch size to: 2 ...
0%| | 0/1536 [00:00<?, ?it/s] 100%|██████████| 1536/1536 [00:00<00:00, 43882.62it/s]
INFO:PerfEngine:Start to compile the model...
WARNING:absl:`Input-Token` is not a valid tf.function parameter name. Sanitizing to `Input_Token`.
WARNING:absl:`Input-Segment` is not a valid tf.function parameter name. Sanitizing to `Input_Segment`.
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:CAIL2019:Rebatching batch size to: 2 ...
INFO:TestAccuracy:Start to calculate accuracy...
0%| | 0/1536 [00:00<?, ?it/s]WARNING:absl:`Input-Segment` is not a valid tf.function parameter name. Sanitizing to `Input_Segment`.
WARNING:absl:`Input-Token` is not a valid tf.function parameter name. Sanitizing to `Input_Token`.
WARNING:absl:`Input-Segment` is not a valid tf.function parameter name. Sanitizing to `Input_Segment`.
0%| | 1/1536 [00:05<2:08:33, 5.03s/it] 0%| | 6/1536 [00:05<16:16, 1.57it/s] 1%| | 11/1536 [00:05<07:31, 3.38it/s] 1%| | 16/1536 [00:05<04:26, 5.70it/s] 1%|▏ | 21/1536 [00:05<02:56, 8.58it/s] 2%|▏ | 26/1536 [00:05<02:05, 12.02it/s] 2%|▏ | 31/1536 [00:05<01:34, 15.86it/s] 2%|▏ | 36/1536 [00:05<01:15, 19.92it/s] 3%|▎ | 41/1536 [00:05<01:02, 24.04it/s] 3%|▎ | 46/1536 [00:06<00:53, 28.01it/s] 3%|▎ | 51/1536 [00:06<00:47, 31.46it/s] 4%|▎ | 56/1536 [00:06<00:43, 34.12it/s] 4%|▍ | 61/1536 [00:06<00:40, 36.43it/s] 4%|▍ | 66/1536 [00:06<00:38, 38.27it/s] 5%|▍ | 71/1536 [00:06<00:36, 39.71it/s] 5%|▍ | 76/1536 [00:06<00:36, 40.17it/s] 5%|▌ | 81/1536 [00:06<00:35, 40.89it/s] 6%|▌ | 86/1536 [00:07<00:35, 41.23it/s] 6%|▌ | 91/1536 [00:07<00:34, 41.56it/s] 6%|▋ | 96/1536 [00:07<00:34, 42.01it/s] 7%|▋ | 101/1536 [00:07<00:33, 42.44it/s] 7%|▋ | 106/1536 [00:07<00:33, 42.75it/s] 7%|▋ | 111/1536 [00:07<00:33, 43.03it/s] 8%|▊ | 116/1536 [00:07<00:33, 42.73it/s] 8%|▊ | 121/1536 [00:07<00:33, 42.84it/s] 8%|▊ | 126/1536 [00:07<00:32, 42.88it/s] 9%|▊ | 131/1536 [00:08<00:32, 42.84it/s] 9%|▉ | 136/1536 [00:08<00:32, 42.81it/s] 9%|▉ | 141/1536 [00:08<00:32, 42.75it/s] 10%|▉ | 146/1536 [00:08<00:32, 42.97it/s] 10%|▉ | 151/1536 [00:08<00:32, 42.94it/s] 10%|█ | 156/1536 [00:08<00:32, 42.70it/s] 10%|█ | 161/1536 [00:08<00:32, 42.76it/s] 11%|█ | 166/1536 [00:08<00:31, 43.05it/s] 11%|█ | 171/1536 [00:08<00:31, 43.08it/s] 11%|█▏ | 176/1536 [00:09<00:31, 42.81it/s] 12%|█▏ | 181/1536 [00:09<00:31, 42.66it/s] 12%|█▏ | 186/1536 [00:09<00:31, 42.71it/s] 12%|█▏ | 191/1536 [00:09<00:31, 42.67it/s] 13%|█▎ | 196/1536 [00:09<00:31, 42.82it/s] 13%|█▎ | 201/1536 [00:09<00:31, 42.92it/s] 13%|█▎ | 206/1536 [00:09<00:30, 42.95it/s] 14%|█▎ | 211/1536 [00:09<00:30, 42.96it/s] 14%|█▍ | 216/1536 [00:10<00:30, 43.20it/s] 14%|█▍ | 221/1536 [00:10<00:30, 42.94it/s] 15%|█▍ | 226/1536 [00:10<00:30, 42.65it/s] 15%|█▌ | 231/1536 [00:10<00:30, 42.83it/s] 15%|█▌ | 236/1536 [00:10<00:30, 42.98it/s] 16%|█▌ | 241/1536 [00:10<00:30, 42.93it/s] 16%|█▌ | 246/1536 [00:10<00:30, 42.40it/s] 16%|█▋ | 251/1536 [00:10<00:30, 42.67it/s] 17%|█▋ | 256/1536 [00:10<00:29, 42.79it/s] 17%|█▋ | 261/1536 [00:11<00:29, 42.93it/s] 17%|█▋ | 266/1536 [00:11<00:29, 43.01it/s] 18%|█▊ | 271/1536 [00:11<00:29, 43.06it/s] 18%|█▊ | 276/1536 [00:11<00:29, 43.26it/s] 18%|█▊ | 281/1536 [00:11<00:28, 43.42it/s] 19%|█▊ | 286/1536 [00:11<00:29, 42.82it/s] 19%|█▉ | 291/1536 [00:11<00:29, 42.93it/s] 19%|█▉ | 296/1536 [00:11<00:28, 43.10it/s] 20%|█▉ | 301/1536 [00:12<00:28, 43.24it/s] 20%|█▉ | 306/1536 [00:12<00:28, 42.91it/s] 20%|██ | 311/1536 [00:12<00:28, 42.60it/s] 21%|██ | 316/1536 [00:12<00:28, 42.93it/s] 21%|██ | 321/1536 [00:12<00:28, 42.85it/s] 21%|██ | 326/1536 [00:12<00:28, 42.69it/s] 22%|██▏ | 331/1536 [00:12<00:28, 42.85it/s] 22%|██▏ | 336/1536 [00:12<00:27, 42.96it/s] 22%|██▏ | 341/1536 [00:12<00:27, 42.99it/s] 23%|██▎ | 346/1536 [00:13<00:27, 43.18it/s] 23%|██▎ | 351/1536 [00:13<00:27, 42.94it/s] 23%|██▎ | 356/1536 [00:13<00:27, 43.05it/s] 24%|██▎ | 361/1536 [00:13<00:27, 43.13it/s] 24%|██▍ | 366/1536 [00:13<00:26, 43.90it/s] 24%|██▍ | 371/1536 [00:13<00:26, 44.65it/s] 24%|██▍ | 376/1536 [00:13<00:25, 44.68it/s] 25%|██▍ | 381/1536 [00:13<00:25, 44.79it/s] 25%|██▌ | 386/1536 [00:13<00:25, 45.02it/s] 25%|██▌ | 391/1536 [00:14<00:25, 45.33it/s] 26%|██▌ | 396/1536 [00:14<00:25, 45.19it/s] 26%|██▌ | 401/1536 [00:14<00:25, 45.27it/s] 26%|██▋ | 406/1536 [00:14<00:25, 45.02it/s] 27%|██▋ | 411/1536 [00:14<00:24, 45.36it/s] 27%|██▋ | 416/1536 [00:14<00:24, 45.51it/s] 27%|██▋ | 421/1536 [00:14<00:24, 45.47it/s] 28%|██▊ | 426/1536 [00:14<00:24, 45.23it/s] 28%|██▊ | 431/1536 [00:14<00:24, 45.42it/s] 28%|██▊ | 436/1536 [00:15<00:24, 45.39it/s] 29%|██▊ | 441/1536 [00:15<00:24, 45.61it/s] 29%|██▉ | 446/1536 [00:15<00:23, 45.71it/s] 29%|██▉ | 451/1536 [00:15<00:23, 45.84it/s] 30%|██▉ | 456/1536 [00:15<00:23, 45.49it/s] 30%|███ | 461/1536 [00:15<00:23, 45.07it/s] 30%|███ | 466/1536 [00:15<00:23, 45.18it/s] 31%|███ | 471/1536 [00:15<00:23, 45.17it/s] 31%|███ | 476/1536 [00:15<00:23, 45.65it/s] 31%|███▏ | 481/1536 [00:16<00:23, 45.75it/s] 32%|███▏ | 486/1536 [00:16<00:22, 45.72it/s] 32%|███▏ | 491/1536 [00:16<00:22, 45.64it/s] 32%|███▏ | 496/1536 [00:16<00:22, 45.75it/s] 33%|███▎ | 501/1536 [00:16<00:22, 45.58it/s] 33%|███▎ | 506/1536 [00:16<00:22, 45.60it/s] 33%|███▎ | 511/1536 [00:16<00:22, 45.49it/s] 34%|███▎ | 516/1536 [00:16<00:22, 45.20it/s] 34%|███▍ | 521/1536 [00:16<00:22, 45.35it/s] 34%|███▍ | 526/1536 [00:17<00:22, 45.40it/s] 35%|███▍ | 531/1536 [00:17<00:22, 45.36it/s] 35%|███▍ | 536/1536 [00:17<00:21, 45.64it/s] 35%|███▌ | 541/1536 [00:17<00:21, 45.86it/s] 36%|███▌ | 546/1536 [00:17<00:21, 45.76it/s] 36%|███▌ | 551/1536 [00:17<00:21, 45.88it/s] 36%|███▌ | 556/1536 [00:17<00:21, 45.61it/s] 37%|███▋ | 561/1536 [00:17<00:21, 45.66it/s] 37%|███▋ | 566/1536 [00:17<00:21, 45.27it/s] 37%|███▋ | 571/1536 [00:18<00:21, 45.43it/s] 38%|███▊ | 576/1536 [00:18<00:21, 45.55it/s] 38%|███▊ | 581/1536 [00:18<00:21, 45.28it/s] 38%|███▊ | 586/1536 [00:18<00:20, 45.31it/s] 38%|███▊ | 591/1536 [00:18<00:20, 45.48it/s] 39%|███▉ | 596/1536 [00:18<00:20, 45.33it/s] 39%|███▉ | 601/1536 [00:18<00:20, 45.38it/s] 39%|███▉ | 606/1536 [00:18<00:20, 45.32it/s] 40%|███▉ | 611/1536 [00:18<00:20, 45.31it/s] 40%|████ | 616/1536 [00:19<00:20, 45.30it/s] 40%|████ | 621/1536 [00:19<00:20, 45.36it/s] 41%|████ | 626/1536 [00:19<00:19, 45.69it/s] 41%|████ | 631/1536 [00:19<00:19, 45.50it/s] 41%|████▏ | 636/1536 [00:19<00:19, 45.17it/s] 42%|████▏ | 641/1536 [00:19<00:19, 45.17it/s] 42%|████▏ | 646/1536 [00:19<00:19, 45.23it/s] 42%|████▏ | 651/1536 [00:19<00:19, 45.14it/s] 43%|████▎ | 656/1536 [00:19<00:19, 45.49it/s] 43%|████▎ | 661/1536 [00:20<00:19, 45.49it/s] 43%|████▎ | 666/1536 [00:20<00:19, 45.08it/s] 44%|████▎ | 671/1536 [00:20<00:19, 44.82it/s] 44%|████▍ | 676/1536 [00:20<00:19, 44.82it/s] 44%|████▍ | 681/1536 [00:20<00:19, 44.94it/s] 45%|████▍ | 686/1536 [00:20<00:18, 45.17it/s] 45%|████▍ | 691/1536 [00:20<00:18, 45.53it/s] 45%|████▌ | 696/1536 [00:20<00:18, 45.78it/s] 46%|████▌ | 701/1536 [00:20<00:18, 45.61it/s] 46%|████▌ | 706/1536 [00:21<00:18, 45.54it/s] 46%|████▋ | 711/1536 [00:21<00:18, 45.43it/s] 47%|████▋ | 716/1536 [00:21<00:18, 45.46it/s] 47%|████▋ | 721/1536 [00:21<00:17, 45.54it/s] 47%|████▋ | 726/1536 [00:21<00:17, 45.48it/s] 48%|████▊ | 731/1536 [00:21<00:17, 45.23it/s] 48%|████▊ | 736/1536 [00:21<00:17, 45.24it/s] 48%|████▊ | 741/1536 [00:21<00:17, 45.48it/s] 49%|████▊ | 746/1536 [00:21<00:17, 45.58it/s] 49%|████▉ | 751/1536 [00:21<00:17, 45.44it/s] 49%|████▉ | 756/1536 [00:22<00:16, 45.98it/s] 50%|████▉ | 761/1536 [00:22<00:16, 45.69it/s] 50%|████▉ | 766/1536 [00:22<00:16, 45.75it/s] 50%|█████ | 771/1536 [00:22<00:16, 45.51it/s] 51%|█████ | 776/1536 [00:22<00:16, 45.73it/s] 51%|█████ | 781/1536 [00:22<00:16, 45.57it/s] 51%|█████ | 786/1536 [00:22<00:16, 45.73it/s] 51%|█████▏ | 791/1536 [00:22<00:16, 45.33it/s] 52%|█████▏ | 796/1536 [00:22<00:16, 45.34it/s] 52%|█████▏ | 801/1536 [00:23<00:16, 45.31it/s] 52%|█████▏ | 806/1536 [00:23<00:16, 45.51it/s] 53%|█████▎ | 811/1536 [00:23<00:15, 45.46it/s] 53%|█████▎ | 816/1536 [00:23<00:15, 45.28it/s] 53%|█████▎ | 821/1536 [00:23<00:15, 45.69it/s] 54%|█████▍ | 826/1536 [00:23<00:15, 45.50it/s] 54%|█████▍ | 831/1536 [00:23<00:15, 45.37it/s] 54%|█████▍ | 836/1536 [00:23<00:15, 45.58it/s] 55%|█████▍ | 841/1536 [00:23<00:15, 45.40it/s] 55%|█████▌ | 846/1536 [00:24<00:15, 45.37it/s] 55%|█████▌ | 851/1536 [00:24<00:15, 44.90it/s] 56%|█████▌ | 856/1536 [00:24<00:15, 44.83it/s] 56%|█████▌ | 861/1536 [00:24<00:14, 45.12it/s] 56%|█████▋ | 866/1536 [00:24<00:14, 45.47it/s] 57%|█████▋ | 871/1536 [00:24<00:14, 46.00it/s] 57%|█████▋ | 876/1536 [00:24<00:14, 46.43it/s] 57%|█████▋ | 881/1536 [00:24<00:14, 46.61it/s] 58%|█████▊ | 886/1536 [00:24<00:14, 46.32it/s] 58%|█████▊ | 891/1536 [00:25<00:13, 46.19it/s] 58%|█████▊ | 896/1536 [00:25<00:13, 45.87it/s] 59%|█████▊ | 901/1536 [00:25<00:13, 45.76it/s] 59%|█████▉ | 906/1536 [00:25<00:13, 45.53it/s] 59%|█████▉ | 911/1536 [00:25<00:13, 45.38it/s] 60%|█████▉ | 916/1536 [00:25<00:13, 45.72it/s] 60%|█████▉ | 921/1536 [00:25<00:13, 45.64it/s] 60%|██████ | 926/1536 [00:25<00:13, 45.92it/s] 61%|██████ | 931/1536 [00:25<00:13, 45.83it/s] 61%|██████ | 936/1536 [00:26<00:13, 45.78it/s] 61%|██████▏ | 941/1536 [00:26<00:13, 45.06it/s] 62%|██████▏ | 946/1536 [00:26<00:13, 44.73it/s] 62%|██████▏ | 951/1536 [00:26<00:13, 44.48it/s] 62%|██████▏ | 956/1536 [00:26<00:13, 44.22it/s] 63%|██████▎ | 961/1536 [00:26<00:13, 43.97it/s] 63%|██████▎ | 966/1536 [00:26<00:12, 43.87it/s] 63%|██████▎ | 971/1536 [00:26<00:12, 43.49it/s] 64%|██████▎ | 976/1536 [00:26<00:12, 43.56it/s] 64%|██████▍ | 981/1536 [00:27<00:12, 43.57it/s] 64%|██████▍ | 986/1536 [00:27<00:12, 43.58it/s] 65%|██████▍ | 991/1536 [00:27<00:12, 43.62it/s] 65%|██████▍ | 996/1536 [00:27<00:12, 43.53it/s] 65%|██████▌ | 1001/1536 [00:27<00:12, 43.52it/s] 65%|██████▌ | 1006/1536 [00:27<00:12, 43.15it/s] 66%|██████▌ | 1011/1536 [00:27<00:12, 42.57it/s] 66%|██████▌ | 1016/1536 [00:27<00:12, 42.24it/s] 66%|██████▋ | 1021/1536 [00:28<00:12, 41.94it/s] 67%|██████▋ | 1026/1536 [00:28<00:12, 41.67it/s] 67%|██████▋ | 1031/1536 [00:28<00:12, 41.28it/s] 67%|██████▋ | 1036/1536 [00:28<00:12, 41.30it/s] 68%|██████▊ | 1041/1536 [00:28<00:11, 41.30it/s] 68%|██████▊ | 1046/1536 [00:28<00:11, 41.26it/s] 68%|██████▊ | 1051/1536 [00:28<00:11, 41.33it/s] 69%|██████▉ | 1056/1536 [00:28<00:11, 41.38it/s] 69%|██████▉ | 1061/1536 [00:28<00:11, 41.34it/s] 69%|██████▉ | 1066/1536 [00:29<00:11, 41.35it/s] 70%|██████▉ | 1071/1536 [00:29<00:11, 41.28it/s] 70%|███████ | 1076/1536 [00:29<00:11, 41.33it/s] 70%|███████ | 1081/1536 [00:29<00:11, 41.27it/s] 71%|███████ | 1086/1536 [00:29<00:10, 41.05it/s] 71%|███████ | 1091/1536 [00:29<00:10, 41.27it/s] 71%|███████▏ | 1096/1536 [00:29<00:10, 41.31it/s] 72%|███████▏ | 1101/1536 [00:29<00:10, 41.28it/s] 72%|███████▏ | 1106/1536 [00:30<00:10, 41.30it/s] 72%|███████▏ | 1111/1536 [00:30<00:10, 41.25it/s] 73%|███████▎ | 1116/1536 [00:30<00:10, 41.26it/s] 73%|███████▎ | 1121/1536 [00:30<00:10, 41.35it/s] 73%|███████▎ | 1126/1536 [00:30<00:09, 41.44it/s] 74%|███████▎ | 1131/1536 [00:30<00:09, 41.52it/s] 74%|███████▍ | 1136/1536 [00:30<00:09, 41.42it/s] 74%|███████▍ | 1141/1536 [00:30<00:09, 41.22it/s] 75%|███████▍ | 1146/1536 [00:31<00:09, 41.24it/s] 75%|███████▍ | 1151/1536 [00:31<00:09, 41.29it/s] 75%|███████▌ | 1156/1536 [00:31<00:09, 41.35it/s] 76%|███████▌ | 1161/1536 [00:31<00:09, 41.40it/s] 76%|███████▌ | 1166/1536 [00:31<00:08, 41.41it/s] 76%|███████▌ | 1171/1536 [00:31<00:08, 41.37it/s] 77%|███████▋ | 1176/1536 [00:31<00:08, 41.38it/s] 77%|███████▋ | 1181/1536 [00:31<00:08, 41.37it/s] 77%|███████▋ | 1186/1536 [00:32<00:08, 41.41it/s] 78%|███████▊ | 1191/1536 [00:32<00:08, 41.46it/s] 78%|███████▊ | 1196/1536 [00:32<00:08, 41.17it/s] 78%|███████▊ | 1201/1536 [00:32<00:08, 41.25it/s] 79%|███████▊ | 1206/1536 [00:32<00:07, 41.28it/s] 79%|███████▉ | 1211/1536 [00:32<00:07, 41.36it/s] 79%|███████▉ | 1216/1536 [00:32<00:07, 41.40it/s] 79%|███████▉ | 1221/1536 [00:32<00:07, 41.34it/s] 80%|███████▉ | 1226/1536 [00:32<00:07, 41.49it/s] 80%|████████ | 1231/1536 [00:33<00:07, 41.43it/s] 80%|████████ | 1236/1536 [00:33<00:07, 41.42it/s] 81%|████████ | 1241/1536 [00:33<00:07, 41.44it/s] 81%|████████ | 1246/1536 [00:33<00:07, 41.42it/s] 81%|████████▏ | 1251/1536 [00:33<00:06, 41.47it/s] 82%|████████▏ | 1256/1536 [00:33<00:06, 41.37it/s] 82%|████████▏ | 1261/1536 [00:33<00:06, 41.35it/s] 82%|████████▏ | 1266/1536 [00:33<00:06, 41.37it/s] 83%|████████▎ | 1271/1536 [00:34<00:06, 41.37it/s] 83%|████████▎ | 1276/1536 [00:34<00:06, 41.37it/s] 83%|████████▎ | 1281/1536 [00:34<00:06, 41.49it/s] 84%|████████▎ | 1286/1536 [00:34<00:06, 41.47it/s] 84%|████████▍ | 1291/1536 [00:34<00:05, 41.40it/s] 84%|████████▍ | 1296/1536 [00:34<00:05, 41.40it/s] 85%|████████▍ | 1301/1536 [00:34<00:05, 41.31it/s] 85%|████████▌ | 1306/1536 [00:34<00:05, 41.08it/s] 85%|████████▌ | 1311/1536 [00:35<00:05, 41.16it/s] 86%|████████▌ | 1316/1536 [00:35<00:05, 41.26it/s] 86%|████████▌ | 1321/1536 [00:35<00:05, 41.44it/s] 86%|████████▋ | 1326/1536 [00:35<00:05, 41.45it/s] 87%|████████▋ | 1331/1536 [00:35<00:04, 41.42it/s] 87%|████████▋ | 1336/1536 [00:35<00:04, 41.53it/s] 87%|████████▋ | 1341/1536 [00:35<00:04, 41.76it/s] 88%|████████▊ | 1346/1536 [00:35<00:04, 42.17it/s] 88%|████████▊ | 1351/1536 [00:35<00:04, 42.54it/s] 88%|████████▊ | 1356/1536 [00:36<00:04, 42.60it/s] 89%|████████▊ | 1361/1536 [00:36<00:04, 42.56it/s] 89%|████████▉ | 1366/1536 [00:36<00:03, 42.93it/s] 89%|████████▉ | 1371/1536 [00:36<00:03, 42.49it/s] 90%|████████▉ | 1376/1536 [00:36<00:03, 42.24it/s] 90%|████████▉ | 1381/1536 [00:36<00:03, 41.97it/s] 90%|█████████ | 1386/1536 [00:36<00:03, 41.78it/s] 91%|█████████ | 1391/1536 [00:36<00:03, 41.69it/s] 91%|█████████ | 1396/1536 [00:37<00:03, 41.63it/s] 91%|█████████ | 1401/1536 [00:37<00:03, 41.51it/s] 92%|█████████▏| 1406/1536 [00:37<00:03, 41.46it/s] 92%|█████████▏| 1411/1536 [00:37<00:03, 41.42it/s] 92%|█████████▏| 1416/1536 [00:37<00:02, 41.20it/s] 93%|█████████▎| 1421/1536 [00:37<00:02, 41.21it/s] 93%|█████████▎| 1426/1536 [00:37<00:02, 41.23it/s] 93%|█████████▎| 1431/1536 [00:37<00:02, 41.24it/s] 93%|█████████▎| 1436/1536 [00:38<00:02, 41.25it/s] 94%|█████████▍| 1441/1536 [00:38<00:02, 41.29it/s] 94%|█████████▍| 1446/1536 [00:38<00:02, 41.34it/s] 94%|█████████▍| 1451/1536 [00:38<00:02, 41.40it/s] 95%|█████████▍| 1456/1536 [00:38<00:01, 41.39it/s] 95%|█████████▌| 1461/1536 [00:38<00:01, 41.49it/s] 95%|█████████▌| 1466/1536 [00:38<00:01, 41.40it/s] 96%|█████████▌| 1471/1536 [00:38<00:01, 41.41it/s] 96%|█████████▌| 1476/1536 [00:39<00:01, 41.30it/s] 96%|█████████▋| 1481/1536 [00:39<00:01, 41.23it/s] 97%|█████████▋| 1486/1536 [00:39<00:01, 41.32it/s] 97%|█████████▋| 1491/1536 [00:39<00:01, 41.48it/s] 97%|█████████▋| 1496/1536 [00:39<00:00, 41.59it/s] 98%|█████████▊| 1501/1536 [00:39<00:00, 41.58it/s] 98%|█████████▊| 1506/1536 [00:39<00:00, 41.51it/s] 98%|█████████▊| 1511/1536 [00:39<00:00, 41.44it/s] 99%|█████████▊| 1516/1536 [00:39<00:00, 41.44it/s] 99%|█████████▉| 1521/1536 [00:40<00:00, 41.53it/s] 99%|█████████▉| 1526/1536 [00:40<00:00, 41.61it/s] 100%|█████████▉| 1531/1536 [00:40<00:00, 41.41it/s] 100%|██████████| 1536/1536 [00:40<00:00, 41.44it/s] 100%|██████████| 1536/1536 [00:40<00:00, 37.97it/s]
INFO:TestAccuracy:Batch size is 2, Accuracy: 0.64388
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 2, QPS: 84, Avg Latency:23.74, Tail Latency:25.95
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 4, QPS: 120, Avg Latency:33.19, Tail Latency:35.58
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 8, QPS: 151, Avg Latency:52.89, Tail Latency:55.29
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 16, QPS: 177, Avg Latency:90.32, Tail Latency:93.41
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 32, QPS: 186, Avg Latency:171.56, Tail Latency:175.45
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 64, QPS: 192, Avg Latency:333.24, Tail Latency:336.96
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/roformer-tf-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/roformer-tf-fp32/ROFORMER-TF-FP32-TO-FP32.JSON.pdf ]
ByteMLPerf/byte_infer_perf/general_perf/log/unet-onnx-fp32.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: unet-onnx-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: fake_dataset
INFO:PerfEngine:Start to compile the model...
2024-11-13 16:56:20.201361268 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:56:20.201382315 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:56:25.964615675 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.964826323 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.965009363 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.965184300 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.965348905 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.965503707 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.965694886 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.965932871 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.966081753 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.966227787 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.966378621 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.966519452 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.966661988 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.966815441 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.966968726 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:25.967119693 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
2024-11-13 16:56:27.573289882 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:56:27.573307190 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:56:28.688445370 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.688656268 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.688841376 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.689018399 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.689191624 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.689354859 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.689553425 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.689791109 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.689949768 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.690102439 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.690260931 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.690409049 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.690559476 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.690710863 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.690862682 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:28.691025036 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 4, QPS: 60, Avg Latency:66.12, Tail Latency:68.21
2024-11-13 16:56:39.686074187 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:56:39.686093149 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:56:40.787414662 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.787617817 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.787785792 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.787959011 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.788121264 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.788285495 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.788484116 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.788711000 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.788859122 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.789006019 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.789156050 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.789297772 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.789440681 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.789590582 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.789734735 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:40.789884469 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 8, QPS: 71, Avg Latency:112.41, Tail Latency:114.41
2024-11-13 16:56:57.352999123 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:56:57.353017861 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:56:58.453582623 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.453789839 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.453971211 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.454132386 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.454298664 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.454459461 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.454655737 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.454885113 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.455022618 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.455169863 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.455322420 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.455464923 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.455601553 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.455754696 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.455905308 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:56:58.456048607 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 16, QPS: 82, Avg Latency:194.67, Tail Latency:197.02
2024-11-13 16:57:25.709644374 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:57:25.709663503 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:57:26.814439514 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.814640351 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.814820106 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.814992975 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.815163488 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.815325092 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.815515371 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.815753946 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.815902983 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.816045466 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.816197755 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.816342634 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.816485177 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.816638328 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.816779307 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:57:26.816923292 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 24, QPS: 87, Avg Latency:274.63, Tail Latency:276.89
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/unet-onnx-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/unet-onnx-fp32/UNET-ONNX-FP32-TO-FP32.JSON.pdf ]
ByteMLPerf/byte_infer_perf/general_perf/log/vae-decoder-onnx-fp32.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: vae-decoder-onnx-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: fake_dataset
INFO:PerfEngine:Start to compile the model...
2024-11-13 16:49:36.004666935 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:49:36.004685902 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:49:40.971856424 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971889400 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971909342 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971954815 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971968282 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971981624 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.971993351 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972006663 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972017837 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972030535 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972040996 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972066390 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972075951 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972086154 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972095979 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972107985 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972119795 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972136645 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972148083 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972161282 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972171842 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972183052 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972193217 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972211054 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972222647 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972235663 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972245696 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972255707 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972265268 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:40.972276519 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
2024-11-13 16:49:41.441482527 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:49:41.441497193 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:49:41.930850391 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930885030 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930904787 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930942707 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930954161 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930967499 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930978987 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.930990902 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931003087 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931015077 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931028041 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931053157 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931064168 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931074160 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931084046 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931094698 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931104812 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931122497 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931132287 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931145698 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931155830 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931166811 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931177168 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931194424 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931204493 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931219046 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931230482 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931241363 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931251511 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:49:41.931263572 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 4, QPS: 26, Avg Latency:150.75, Tail Latency:152.65
2024-11-13 16:50:02.468503584 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:50:02.468518970 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:50:02.946045400 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946076228 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946093162 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946128849 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946140256 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946151874 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946163350 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946175829 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946187042 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946198743 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946210104 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946237843 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946248847 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946259523 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946268539 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946278193 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946287770 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946305171 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946314586 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946327956 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946337464 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946347405 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946355941 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946371480 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946381409 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946393566 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946402462 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946411952 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946421870 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:02.946433606 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 8, QPS: 26, Avg Latency:297.52, Tail Latency:299.82
2024-11-13 16:50:42.075327817 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:50:42.075342142 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:50:42.551250958 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551282130 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551301457 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551337911 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551349816 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551361834 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551374154 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551386303 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551396495 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551407953 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551418837 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551444188 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551454417 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551464446 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551474311 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551484116 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551494686 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551512765 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551523512 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551536881 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551547525 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551558181 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551568814 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551585527 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551595671 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551606255 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551615057 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551623827 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551631899 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:50:42.551640506 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 16, QPS: 25, Avg Latency:616.06, Tail Latency:618.15
2024-11-13 16:52:03.159653741 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:52:03.159669235 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:52:03.653566788 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653597010 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653614238 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653650530 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653663770 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653676318 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653685843 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653697473 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653708188 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653720238 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653729901 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653755391 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653765969 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653775027 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653782986 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653791005 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653800425 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653816376 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653825771 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653838314 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653847770 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653859110 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653868125 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653890068 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653900584 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653911796 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653921980 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653932757 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653941503 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:52:03.653952407 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 24, QPS: 25, Avg Latency:930.45, Tail Latency:932.79
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/vae-decoder-onnx-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/vae-decoder-onnx-fp32/VAE-DECODER-ONNX-FP32-TO-FP32.JSON.pdf ]
ByteMLPerf/byte_infer_perf/general_perf/log/vae-encoder-onnx-fp32.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: vae-encoder-onnx-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: fake_dataset
INFO:PerfEngine:Start to compile the model...
2024-11-13 16:46:54.191740885 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:46:54.191759087 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:46:59.150361604 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150391639 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150405303 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150416984 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150434631 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150445757 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150458965 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150470802 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150487984 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150499555 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150514117 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150523824 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150537877 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150547716 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150558286 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150568119 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150580297 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150591482 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150607008 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150651834 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150662854 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:46:59.150674555 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
2024-11-13 16:46:59.580210398 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:46:59.580224783 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:47:00.044952484 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.044983008 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.044996134 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045008901 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045027540 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045040134 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045055334 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045066731 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045083819 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045096304 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045111111 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045121100 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045135177 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045145100 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045156377 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045165963 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045175649 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045186804 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045203440 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045236585 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045247040 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:00.045257947 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 4, QPS: 55, Avg Latency:72.39, Tail Latency:74.4
2024-11-13 16:47:10.455819780 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:47:10.455834299 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:47:10.917825142 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917854250 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917866318 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917880951 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917899164 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917909723 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917922919 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917935015 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917951953 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917962624 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917975429 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917985730 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.917998993 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918007165 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918018157 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918027202 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918038331 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918047943 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918063105 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918095722 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918105524 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:10.918115016 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 8, QPS: 56, Avg Latency:142.6, Tail Latency:144.75
2024-11-13 16:47:29.966399973 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:47:29.966415034 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:47:30.429985531 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430014162 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430026571 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430036430 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430052250 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430063533 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430076562 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430087163 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430102667 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430113526 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430128017 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430139353 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430154673 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430163795 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430173602 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430182317 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430192331 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430201858 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430217286 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430247703 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430258509 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:47:30.430267612 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 16, QPS: 54, Avg Latency:293.01, Tail Latency:295.03
2024-11-13 16:48:09.048249394 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:48:09.048264926 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2024-11-13 16:48:09.513201066 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513230691 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513243084 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513252307 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513269287 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513280975 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513294247 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513304995 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513321387 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513332448 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513345003 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513354399 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513367832 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513376162 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513386325 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513394779 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513404904 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513415758 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513432502 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513466045 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513477124 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
2024-11-13 16:48:09.513487226 [W:onnxruntime:Default, miopen_common.h:111 ClampMiopenBatchNormEpsilon] Provided epsilon is smaller than MIOPEN_BN_MIN_EPSILON. Setting it to MIOPEN_BN_MIN_EPSILON
INFO:BackendDCU:Batch size is 24, QPS: 53, Avg Latency:444.56, Tail Latency:446.61
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/vae-encoder-onnx-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/vae-encoder-onnx-fp32/VAE-ENCODER-ONNX-FP32-TO-FP32.JSON.pdf ]
ByteMLPerf/byte_infer_perf/general_perf/log/videobert-onnx-fp32.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: videobert-onnx-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: open_cifar
INFO:CIFAR100:Initial...
0%| | 0/10000 [00:00<?, ?it/s] 1%| | 85/10000 [00:00<00:11, 846.81it/s] 2%|▏ | 188/10000 [00:00<00:10, 949.77it/s] 3%|▎ | 290/10000 [00:00<00:09, 980.77it/s] 4%|▍ | 393/10000 [00:00<00:09, 998.05it/s] 5%|▍ | 496/10000 [00:00<00:09, 1007.51it/s] 6%|▌ | 599/10000 [00:00<00:09, 1013.39it/s] 7%|▋ | 704/10000 [00:00<00:09, 1022.97it/s] 8%|▊ | 808/10000 [00:00<00:08, 1026.75it/s] 9%|▉ | 912/10000 [00:00<00:08, 1028.47it/s] 10%|█ | 1016/10000 [00:01<00:08, 1030.70it/s] 11%|█ | 1121/10000 [00:01<00:08, 1034.03it/s] 12%|█▏ | 1226/10000 [00:01<00:08, 1037.02it/s] 13%|█▎ | 1331/10000 [00:01<00:08, 1038.01it/s] 14%|█▍ | 1435/10000 [00:01<00:08, 1037.56it/s] 15%|█▌ | 1539/10000 [00:01<00:08, 1037.84it/s] 16%|█▋ | 1644/10000 [00:01<00:08, 1039.03it/s] 17%|█▋ | 1748/10000 [00:01<00:07, 1037.01it/s] 19%|█▊ | 1852/10000 [00:01<00:07, 1037.26it/s] 20%|█▉ | 1957/10000 [00:01<00:07, 1038.46it/s] 21%|██ | 2061/10000 [00:02<00:07, 1038.71it/s] 22%|██▏ | 2165/10000 [00:02<00:07, 1038.85it/s] 23%|██▎ | 2269/10000 [00:02<00:07, 1039.11it/s] 24%|██▎ | 2374/10000 [00:02<00:07, 1040.77it/s] 25%|██▍ | 2479/10000 [00:02<00:07, 1040.03it/s] 26%|██▌ | 2584/10000 [00:02<00:07, 1035.91it/s] 27%|██▋ | 2688/10000 [00:02<00:07, 1033.72it/s] 28%|██▊ | 2792/10000 [00:02<00:06, 1033.93it/s] 29%|██▉ | 2896/10000 [00:02<00:06, 1034.66it/s] 30%|███ | 3000/10000 [00:02<00:06, 1035.90it/s] 31%|███ | 3105/10000 [00:03<00:06, 1037.56it/s] 32%|███▏ | 3210/10000 [00:03<00:06, 1038.64it/s] 33%|███▎ | 3315/10000 [00:03<00:06, 1039.29it/s] 34%|███▍ | 3420/10000 [00:03<00:06, 1039.68it/s] 35%|███▌ | 3525/10000 [00:03<00:06, 1039.80it/s] 36%|███▋ | 3630/10000 [00:03<00:06, 1040.40it/s] 37%|███▋ | 3735/10000 [00:03<00:06, 1041.52it/s] 38%|███▊ | 3840/10000 [00:03<00:05, 1043.26it/s] 39%|███▉ | 3945/10000 [00:03<00:05, 1043.53it/s] 40%|████ | 4050/10000 [00:03<00:05, 1045.07it/s] 42%|████▏ | 4155/10000 [00:04<00:05, 1045.41it/s] 43%|████▎ | 4261/10000 [00:04<00:05, 1046.94it/s] 44%|████▎ | 4366/10000 [00:04<00:05, 1045.40it/s] 45%|████▍ | 4471/10000 [00:04<00:05, 1042.47it/s] 46%|████▌ | 4576/10000 [00:04<00:05, 1041.14it/s] 47%|████▋ | 4681/10000 [00:04<00:05, 1043.29it/s] 48%|████▊ | 4787/10000 [00:04<00:04, 1047.55it/s] 49%|████▉ | 4892/10000 [00:04<00:04, 1047.22it/s] 50%|████▉ | 4997/10000 [00:04<00:04, 1046.02it/s] 51%|█████ | 5102/10000 [00:04<00:04, 1046.88it/s] 52%|█████▏ | 5207/10000 [00:05<00:04, 1047.49it/s] 53%|█████▎ | 5312/10000 [00:05<00:04, 1045.96it/s] 54%|█████▍ | 5417/10000 [00:05<00:04, 1045.76it/s] 55%|█████▌ | 5522/10000 [00:05<00:04, 1045.85it/s] 56%|█████▋ | 5627/10000 [00:05<00:04, 1042.67it/s] 57%|█████▋ | 5732/10000 [00:05<00:04, 1041.26it/s] 58%|█████▊ | 5837/10000 [00:05<00:04, 1035.09it/s] 59%|█████▉ | 5941/10000 [00:05<00:03, 1036.39it/s] 60%|██████ | 6045/10000 [00:05<00:03, 1037.07it/s] 61%|██████▏ | 6149/10000 [00:05<00:03, 1037.31it/s] 63%|██████▎ | 6253/10000 [00:06<00:03, 1036.91it/s] 64%|██████▎ | 6357/10000 [00:06<00:03, 1036.73it/s] 65%|██████▍ | 6461/10000 [00:06<00:03, 1036.87it/s] 66%|██████▌ | 6565/10000 [00:06<00:03, 1037.40it/s] 67%|██████▋ | 6669/10000 [00:06<00:03, 1037.76it/s] 68%|██████▊ | 6773/10000 [00:06<00:03, 1037.97it/s] 69%|██████▉ | 6877/10000 [00:06<00:03, 1037.72it/s] 70%|██████▉ | 6982/10000 [00:06<00:02, 1038.69it/s] 71%|███████ | 7087/10000 [00:06<00:02, 1040.24it/s] 72%|███████▏ | 7192/10000 [00:06<00:02, 1041.53it/s] 73%|███████▎ | 7297/10000 [00:07<00:02, 1041.34it/s] 74%|███████▍ | 7402/10000 [00:07<00:02, 1041.78it/s] 75%|███████▌ | 7507/10000 [00:07<00:02, 1042.38it/s] 76%|███████▌ | 7612/10000 [00:07<00:02, 1043.31it/s] 77%|███████▋ | 7717/10000 [00:07<00:02, 1042.76it/s] 78%|███████▊ | 7822/10000 [00:07<00:02, 1041.92it/s] 79%|███████▉ | 7927/10000 [00:07<00:01, 1040.59it/s] 80%|████████ | 8032/10000 [00:07<00:01, 1041.74it/s] 81%|████████▏ | 8137/10000 [00:07<00:01, 1042.20it/s] 82%|████████▏ | 8242/10000 [00:07<00:01, 1042.21it/s] 83%|████████▎ | 8347/10000 [00:08<00:01, 1041.90it/s] 85%|████████▍ | 8452/10000 [00:08<00:01, 1041.00it/s] 86%|████████▌ | 8557/10000 [00:08<00:01, 1040.07it/s] 87%|████████▋ | 8662/10000 [00:08<00:01, 1038.40it/s] 88%|████████▊ | 8766/10000 [00:08<00:01, 1038.07it/s] 89%|████████▊ | 8870/10000 [00:08<00:01, 1037.94it/s] 90%|████████▉ | 8975/10000 [00:08<00:00, 1039.10it/s] 91%|█████████ | 9079/10000 [00:08<00:00, 1038.25it/s] 92%|█████████▏| 9183/10000 [00:08<00:00, 1038.30it/s] 93%|█████████▎| 9287/10000 [00:08<00:00, 1038.01it/s] 94%|█████████▍| 9392/10000 [00:09<00:00, 1039.22it/s] 95%|█████████▍| 9497/10000 [00:09<00:00, 1040.22it/s] 96%|█████████▌| 9602/10000 [00:09<00:00, 1041.88it/s] 97%|█████████▋| 9707/10000 [00:09<00:00, 1043.59it/s] 98%|█████████▊| 9813/10000 [00:09<00:00, 1045.57it/s] 99%|█████████▉| 9918/10000 [00:09<00:00, 1046.52it/s] 100%|██████████| 10000/10000 [00:09<00:00, 1037.79it/s]
INFO:CIFAR100:Preprocessing...
INFO:CIFAR100:Rebatching batch size to: 1 ...
0%| | 0/10000 [00:00<?, ?it/s] 100%|██████████| 10000/10000 [00:00<00:00, 906856.93it/s]
INFO:PerfEngine:Start to compile the model...
2024-11-13 16:35:01.606623753 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:35:01.606645753 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:CIFAR100:Rebatching batch size to: 4 ...
0%| | 0/2500 [00:00<?, ?it/s] 100%|██████████| 2500/2500 [00:00<00:00, 787041.96it/s]
INFO:TestAccuracy:Start to calculate accuracy...
0%| | 0/2500 [00:00<?, ?it/s] 0%| | 1/2500 [00:00<33:42, 1.24it/s] 0%| | 3/2500 [00:00<10:17, 4.04it/s] 0%| | 6/2500 [00:01<05:04, 8.19it/s] 0%| | 9/2500 [00:01<03:33, 11.68it/s] 0%| | 12/2500 [00:01<02:51, 14.54it/s] 1%| | 15/2500 [00:01<02:28, 16.77it/s] 1%| | 18/2500 [00:01<02:14, 18.45it/s] 1%| | 21/2500 [00:01<02:05, 19.71it/s] 1%| | 24/2500 [00:01<02:00, 20.62it/s] 1%| | 27/2500 [00:01<01:56, 21.26it/s] 1%| | 30/2500 [00:02<01:53, 21.69it/s] 1%|▏ | 33/2500 [00:02<01:52, 21.97it/s] 1%|▏ | 36/2500 [00:02<01:50, 22.21it/s] 2%|▏ | 39/2500 [00:02<01:50, 22.32it/s] 2%|▏ | 42/2500 [00:02<01:49, 22.44it/s] 2%|▏ | 45/2500 [00:02<01:49, 22.52it/s] 2%|▏ | 48/2500 [00:02<01:48, 22.58it/s] 2%|▏ | 51/2500 [00:03<01:48, 22.60it/s] 2%|▏ | 54/2500 [00:03<01:48, 22.62it/s] 2%|▏ | 57/2500 [00:03<01:47, 22.63it/s] 2%|▏ | 60/2500 [00:03<01:47, 22.65it/s] 3%|▎ | 63/2500 [00:03<01:47, 22.65it/s] 3%|▎ | 66/2500 [00:03<01:47, 22.65it/s] 3%|▎ | 69/2500 [00:03<01:47, 22.55it/s] 3%|▎ | 72/2500 [00:03<01:47, 22.60it/s] 3%|▎ | 75/2500 [00:04<01:47, 22.61it/s] 3%|▎ | 78/2500 [00:04<01:47, 22.63it/s] 3%|▎ | 81/2500 [00:04<01:46, 22.65it/s] 3%|▎ | 84/2500 [00:04<01:46, 22.65it/s] 3%|▎ | 87/2500 [00:04<01:46, 22.67it/s] 4%|▎ | 90/2500 [00:04<01:46, 22.68it/s] 4%|▎ | 93/2500 [00:04<01:46, 22.67it/s] 4%|▍ | 96/2500 [00:05<01:45, 22.68it/s] 4%|▍ | 99/2500 [00:05<01:46, 22.58it/s] 4%|▍ | 102/2500 [00:05<01:46, 22.62it/s] 4%|▍ | 105/2500 [00:05<01:45, 22.64it/s] 4%|▍ | 108/2500 [00:05<01:45, 22.66it/s] 4%|▍ | 111/2500 [00:05<01:45, 22.67it/s] 5%|▍ | 114/2500 [00:05<01:45, 22.69it/s] 5%|▍ | 117/2500 [00:05<01:45, 22.67it/s] 5%|▍ | 120/2500 [00:06<01:44, 22.67it/s] 5%|▍ | 123/2500 [00:06<01:44, 22.67it/s] 5%|▌ | 126/2500 [00:06<01:44, 22.67it/s] 5%|▌ | 129/2500 [00:06<01:45, 22.57it/s] 5%|▌ | 132/2500 [00:06<01:44, 22.60it/s] 5%|▌ | 135/2500 [00:06<01:44, 22.62it/s] 6%|▌ | 138/2500 [00:06<01:44, 22.65it/s] 6%|▌ | 141/2500 [00:06<01:44, 22.66it/s] 6%|▌ | 144/2500 [00:07<01:43, 22.67it/s] 6%|▌ | 147/2500 [00:07<01:43, 22.66it/s] 6%|▌ | 150/2500 [00:07<01:43, 22.73it/s] 6%|▌ | 153/2500 [00:07<01:43, 22.74it/s] 6%|▌ | 156/2500 [00:07<01:43, 22.74it/s] 6%|▋ | 159/2500 [00:07<01:43, 22.73it/s] 6%|▋ | 162/2500 [00:07<01:43, 22.61it/s] 7%|▋ | 165/2500 [00:08<01:43, 22.64it/s] 7%|▋ | 168/2500 [00:08<01:42, 22.65it/s] 7%|▋ | 171/2500 [00:08<01:42, 22.65it/s] 7%|▋ | 174/2500 [00:08<01:42, 22.65it/s] 7%|▋ | 177/2500 [00:08<01:42, 22.68it/s] 7%|▋ | 180/2500 [00:08<01:42, 22.68it/s] 7%|▋ | 183/2500 [00:08<01:42, 22.68it/s] 7%|▋ | 186/2500 [00:08<01:42, 22.66it/s] 8%|▊ | 189/2500 [00:09<01:42, 22.65it/s] 8%|▊ | 192/2500 [00:09<01:42, 22.55it/s] 8%|▊ | 195/2500 [00:09<01:42, 22.59it/s] 8%|▊ | 198/2500 [00:09<01:41, 22.62it/s] 8%|▊ | 201/2500 [00:09<01:41, 22.63it/s] 8%|▊ | 204/2500 [00:09<01:41, 22.62it/s] 8%|▊ | 207/2500 [00:09<01:41, 22.64it/s] 8%|▊ | 210/2500 [00:10<01:41, 22.66it/s] 9%|▊ | 213/2500 [00:10<01:40, 22.66it/s] 9%|▊ | 216/2500 [00:10<01:40, 22.66it/s] 9%|▉ | 219/2500 [00:10<01:40, 22.66it/s] 9%|▉ | 222/2500 [00:10<01:40, 22.56it/s] 9%|▉ | 225/2500 [00:10<01:40, 22.60it/s] 9%|▉ | 228/2500 [00:10<01:40, 22.62it/s] 9%|▉ | 231/2500 [00:10<01:40, 22.64it/s] 9%|▉ | 234/2500 [00:11<01:40, 22.63it/s] 9%|▉ | 237/2500 [00:11<01:39, 22.64it/s] 10%|▉ | 240/2500 [00:11<01:39, 22.65it/s] 10%|▉ | 243/2500 [00:11<01:39, 22.65it/s] 10%|▉ | 246/2500 [00:11<01:39, 22.66it/s] 10%|▉ | 249/2500 [00:11<01:39, 22.64it/s] 10%|█ | 252/2500 [00:11<01:39, 22.53it/s] 10%|█ | 255/2500 [00:12<01:39, 22.56it/s] 10%|█ | 258/2500 [00:12<01:39, 22.60it/s] 10%|█ | 261/2500 [00:12<01:38, 22.62it/s] 11%|█ | 264/2500 [00:12<01:38, 22.69it/s] 11%|█ | 267/2500 [00:12<01:38, 22.73it/s] 11%|█ | 270/2500 [00:12<01:38, 22.74it/s] 11%|█ | 273/2500 [00:12<01:37, 22.74it/s] 11%|█ | 276/2500 [00:12<01:37, 22.73it/s] 11%|█ | 279/2500 [00:13<01:37, 22.70it/s] 11%|█▏ | 282/2500 [00:13<01:38, 22.58it/s] 11%|█▏ | 285/2500 [00:13<01:38, 22.58it/s] 12%|█▏ | 288/2500 [00:13<01:37, 22.62it/s] 12%|█▏ | 291/2500 [00:13<01:37, 22.67it/s] 12%|█▏ | 294/2500 [00:13<01:37, 22.70it/s] 12%|█▏ | 297/2500 [00:13<01:37, 22.70it/s] 12%|█▏ | 300/2500 [00:14<01:37, 22.66it/s] 12%|█▏ | 303/2500 [00:14<01:36, 22.66it/s] 12%|█▏ | 306/2500 [00:14<01:36, 22.65it/s] 12%|█▏ | 309/2500 [00:14<01:36, 22.66it/s] 12%|█▏ | 312/2500 [00:14<01:37, 22.56it/s] 13%|█▎ | 315/2500 [00:14<01:36, 22.59it/s] 13%|█▎ | 318/2500 [00:14<01:36, 22.61it/s] 13%|█▎ | 321/2500 [00:14<01:36, 22.63it/s] 13%|█▎ | 324/2500 [00:15<01:36, 22.63it/s] 13%|█▎ | 327/2500 [00:15<01:36, 22.63it/s] 13%|█▎ | 330/2500 [00:15<01:35, 22.62it/s] 13%|█▎ | 333/2500 [00:15<01:35, 22.63it/s] 13%|█▎ | 336/2500 [00:15<01:35, 22.64it/s] 14%|█▎ | 339/2500 [00:15<01:35, 22.63it/s] 14%|█▎ | 342/2500 [00:15<01:35, 22.52it/s] 14%|█▍ | 345/2500 [00:16<01:35, 22.53it/s] 14%|█▍ | 348/2500 [00:16<01:35, 22.56it/s] 14%|█▍ | 351/2500 [00:16<01:35, 22.59it/s] 14%|█▍ | 354/2500 [00:16<01:34, 22.60it/s] 14%|█▍ | 357/2500 [00:16<01:34, 22.63it/s] 14%|█▍ | 360/2500 [00:16<01:34, 22.63it/s] 15%|█▍ | 363/2500 [00:16<01:34, 22.63it/s] 15%|█▍ | 366/2500 [00:16<01:34, 22.62it/s] 15%|█▍ | 369/2500 [00:17<01:34, 22.62it/s] 15%|█▍ | 372/2500 [00:17<01:34, 22.52it/s] 15%|█▌ | 375/2500 [00:17<01:34, 22.56it/s] 15%|█▌ | 378/2500 [00:17<01:33, 22.64it/s] 15%|█▌ | 381/2500 [00:17<01:33, 22.69it/s] 15%|█▌ | 384/2500 [00:17<01:33, 22.70it/s] 15%|█▌ | 387/2500 [00:17<01:33, 22.70it/s] 16%|█▌ | 390/2500 [00:17<01:33, 22.67it/s] 16%|█▌ | 393/2500 [00:18<01:32, 22.67it/s] 16%|█▌ | 396/2500 [00:18<01:32, 22.64it/s] 16%|█▌ | 399/2500 [00:18<01:32, 22.62it/s] 16%|█▌ | 402/2500 [00:18<01:33, 22.52it/s] 16%|█▌ | 405/2500 [00:18<01:32, 22.55it/s] 16%|█▋ | 408/2500 [00:18<01:32, 22.58it/s] 16%|█▋ | 411/2500 [00:18<01:32, 22.59it/s] 17%|█▋ | 414/2500 [00:19<01:32, 22.60it/s] 17%|█▋ | 417/2500 [00:19<01:32, 22.60it/s] 17%|█▋ | 420/2500 [00:19<01:32, 22.59it/s] 17%|█▋ | 423/2500 [00:19<01:31, 22.62it/s] 17%|█▋ | 426/2500 [00:19<01:31, 22.62it/s] 17%|█▋ | 429/2500 [00:19<01:31, 22.61it/s] 17%|█▋ | 432/2500 [00:19<01:31, 22.63it/s] 17%|█▋ | 435/2500 [00:19<01:31, 22.53it/s] 18%|█▊ | 438/2500 [00:20<01:31, 22.57it/s] 18%|█▊ | 441/2500 [00:20<01:31, 22.60it/s] 18%|█▊ | 444/2500 [00:20<01:30, 22.61it/s] 18%|█▊ | 447/2500 [00:20<01:30, 22.61it/s] 18%|█▊ | 450/2500 [00:20<01:30, 22.60it/s] 18%|█▊ | 453/2500 [00:20<01:30, 22.61it/s] 18%|█▊ | 456/2500 [00:20<01:30, 22.60it/s] 18%|█▊ | 459/2500 [00:21<01:30, 22.63it/s] 18%|█▊ | 462/2500 [00:21<01:30, 22.60it/s] 19%|█▊ | 465/2500 [00:21<01:30, 22.51it/s] 19%|█▊ | 468/2500 [00:21<01:30, 22.56it/s] 19%|█▉ | 471/2500 [00:21<01:29, 22.62it/s] 19%|█▉ | 474/2500 [00:21<01:29, 22.61it/s] 19%|█▉ | 477/2500 [00:21<01:29, 22.61it/s] 19%|█▉ | 480/2500 [00:21<01:29, 22.62it/s] 19%|█▉ | 483/2500 [00:22<01:29, 22.62it/s] 19%|█▉ | 486/2500 [00:22<01:29, 22.61it/s] 20%|█▉ | 489/2500 [00:22<01:28, 22.65it/s] 20%|█▉ | 492/2500 [00:22<01:28, 22.69it/s] 20%|█▉ | 495/2500 [00:22<01:28, 22.65it/s] 20%|█▉ | 498/2500 [00:22<01:28, 22.70it/s] 20%|██ | 501/2500 [00:22<01:28, 22.70it/s] 20%|██ | 504/2500 [00:23<01:28, 22.68it/s] 20%|██ | 507/2500 [00:23<01:27, 22.66it/s] 20%|██ | 510/2500 [00:23<01:28, 22.61it/s] 21%|██ | 513/2500 [00:23<01:27, 22.61it/s] 21%|██ | 516/2500 [00:23<01:27, 22.62it/s] 21%|██ | 519/2500 [00:23<01:27, 22.60it/s] 21%|██ | 522/2500 [00:23<01:27, 22.60it/s] 21%|██ | 525/2500 [00:23<01:27, 22.50it/s] 21%|██ | 528/2500 [00:24<01:27, 22.53it/s] 21%|██ | 531/2500 [00:24<01:27, 22.55it/s] 21%|██▏ | 534/2500 [00:24<01:27, 22.57it/s] 21%|██▏ | 537/2500 [00:24<01:27, 22.56it/s] 22%|██▏ | 540/2500 [00:24<01:26, 22.59it/s] 22%|██▏ | 543/2500 [00:24<01:26, 22.60it/s] 22%|██▏ | 546/2500 [00:24<01:26, 22.59it/s] 22%|██▏ | 549/2500 [00:25<01:26, 22.60it/s] 22%|██▏ | 552/2500 [00:25<01:26, 22.59it/s] 22%|██▏ | 555/2500 [00:25<01:26, 22.50it/s] 22%|██▏ | 558/2500 [00:25<01:26, 22.53it/s] 22%|██▏ | 561/2500 [00:25<01:25, 22.55it/s] 23%|██▎ | 564/2500 [00:25<01:25, 22.55it/s] 23%|██▎ | 567/2500 [00:25<01:25, 22.62it/s] 23%|██▎ | 570/2500 [00:25<01:25, 22.63it/s] 23%|██▎ | 573/2500 [00:26<01:25, 22.62it/s] 23%|██▎ | 576/2500 [00:26<01:25, 22.62it/s] 23%|██▎ | 579/2500 [00:26<01:24, 22.60it/s] 23%|██▎ | 582/2500 [00:26<01:24, 22.60it/s] 23%|██▎ | 585/2500 [00:26<01:25, 22.51it/s] 24%|██▎ | 588/2500 [00:26<01:24, 22.54it/s] 24%|██▎ | 591/2500 [00:26<01:24, 22.55it/s] 24%|██▍ | 594/2500 [00:27<01:24, 22.56it/s] 24%|██▍ | 597/2500 [00:27<01:24, 22.58it/s] 24%|██▍ | 600/2500 [00:27<01:24, 22.60it/s] 24%|██▍ | 603/2500 [00:27<01:23, 22.66it/s] 24%|██▍ | 606/2500 [00:27<01:23, 22.73it/s] 24%|██▍ | 609/2500 [00:27<01:23, 22.75it/s] 24%|██▍ | 612/2500 [00:27<01:22, 22.77it/s] 25%|██▍ | 615/2500 [00:27<01:23, 22.64it/s] 25%|██▍ | 618/2500 [00:28<01:23, 22.64it/s] 25%|██▍ | 621/2500 [00:28<01:23, 22.64it/s] 25%|██▍ | 624/2500 [00:28<01:22, 22.62it/s] 25%|██▌ | 627/2500 [00:28<01:22, 22.61it/s] 25%|██▌ | 630/2500 [00:28<01:22, 22.62it/s] 25%|██▌ | 633/2500 [00:28<01:22, 22.61it/s] 25%|██▌ | 636/2500 [00:28<01:22, 22.61it/s] 26%|██▌ | 639/2500 [00:29<01:22, 22.60it/s] 26%|██▌ | 642/2500 [00:29<01:22, 22.60it/s] 26%|██▌ | 645/2500 [00:29<01:22, 22.49it/s] 26%|██▌ | 648/2500 [00:29<01:22, 22.52it/s] 26%|██▌ | 651/2500 [00:29<01:22, 22.53it/s] 26%|██▌ | 654/2500 [00:29<01:21, 22.56it/s] 26%|██▋ | 657/2500 [00:29<01:21, 22.58it/s] 26%|██▋ | 660/2500 [00:29<01:21, 22.58it/s] 27%|██▋ | 663/2500 [00:30<01:21, 22.59it/s] 27%|██▋ | 666/2500 [00:30<01:21, 22.58it/s] 27%|██▋ | 669/2500 [00:30<01:21, 22.56it/s] 27%|██▋ | 672/2500 [00:30<01:20, 22.58it/s] 27%|██▋ | 675/2500 [00:30<01:21, 22.47it/s] 27%|██▋ | 678/2500 [00:30<01:20, 22.51it/s] 27%|██▋ | 681/2500 [00:30<01:20, 22.55it/s] 27%|██▋ | 684/2500 [00:31<01:20, 22.56it/s] 27%|██▋ | 687/2500 [00:31<01:20, 22.58it/s] 28%|██▊ | 690/2500 [00:31<01:20, 22.58it/s] 28%|██▊ | 693/2500 [00:31<01:20, 22.57it/s] 28%|██▊ | 696/2500 [00:31<01:19, 22.58it/s] 28%|██▊ | 699/2500 [00:31<01:19, 22.57it/s] 28%|██▊ | 702/2500 [00:31<01:19, 22.60it/s] 28%|██▊ | 705/2500 [00:31<01:19, 22.52it/s] 28%|██▊ | 708/2500 [00:32<01:19, 22.55it/s] 28%|██▊ | 711/2500 [00:32<01:19, 22.59it/s] 29%|██▊ | 714/2500 [00:32<01:18, 22.61it/s] 29%|██▊ | 717/2500 [00:32<01:18, 22.65it/s] 29%|██▉ | 720/2500 [00:32<01:18, 22.65it/s] 29%|██▉ | 723/2500 [00:32<01:18, 22.65it/s] 29%|██▉ | 726/2500 [00:32<01:18, 22.62it/s] 29%|██▉ | 729/2500 [00:32<01:18, 22.61it/s] 29%|██▉ | 732/2500 [00:33<01:18, 22.62it/s] 29%|██▉ | 735/2500 [00:33<01:18, 22.61it/s] 30%|██▉ | 738/2500 [00:33<01:18, 22.51it/s] 30%|██▉ | 741/2500 [00:33<01:18, 22.53it/s] 30%|██▉ | 744/2500 [00:33<01:17, 22.57it/s] 30%|██▉ | 747/2500 [00:33<01:17, 22.56it/s] 30%|███ | 750/2500 [00:33<01:17, 22.56it/s] 30%|███ | 753/2500 [00:34<01:17, 22.56it/s] 30%|███ | 756/2500 [00:34<01:17, 22.58it/s] 30%|███ | 759/2500 [00:34<01:17, 22.58it/s] 30%|███ | 762/2500 [00:34<01:16, 22.58it/s] 31%|███ | 765/2500 [00:34<01:16, 22.58it/s] 31%|███ | 768/2500 [00:34<01:17, 22.49it/s] 31%|███ | 771/2500 [00:34<01:16, 22.53it/s] 31%|███ | 774/2500 [00:34<01:16, 22.54it/s] 31%|███ | 777/2500 [00:35<01:16, 22.56it/s] 31%|███ | 780/2500 [00:35<01:16, 22.58it/s] 31%|███▏ | 783/2500 [00:35<01:16, 22.59it/s] 31%|███▏ | 786/2500 [00:35<01:15, 22.59it/s] 32%|███▏ | 789/2500 [00:35<01:15, 22.58it/s] 32%|███▏ | 792/2500 [00:35<01:15, 22.59it/s] 32%|███▏ | 795/2500 [00:35<01:15, 22.58it/s] 32%|███▏ | 798/2500 [00:36<01:15, 22.48it/s] 32%|███▏ | 801/2500 [00:36<01:15, 22.51it/s] 32%|███▏ | 804/2500 [00:36<01:15, 22.53it/s] 32%|███▏ | 807/2500 [00:36<01:15, 22.54it/s] 32%|███▏ | 810/2500 [00:36<01:14, 22.55it/s] 33%|███▎ | 813/2500 [00:36<01:14, 22.56it/s] 33%|███▎ | 816/2500 [00:36<01:14, 22.56it/s] 33%|███▎ | 819/2500 [00:36<01:14, 22.56it/s] 33%|███▎ | 822/2500 [00:37<01:14, 22.57it/s] 33%|███▎ | 825/2500 [00:37<01:14, 22.56it/s] 33%|███▎ | 828/2500 [00:37<01:14, 22.49it/s] 33%|███▎ | 831/2500 [00:37<01:13, 22.56it/s] 33%|███▎ | 834/2500 [00:37<01:13, 22.61it/s] 33%|███▎ | 837/2500 [00:37<01:13, 22.64it/s] 34%|███▎ | 840/2500 [00:37<01:13, 22.62it/s] 34%|███▎ | 843/2500 [00:38<01:13, 22.64it/s] 34%|███▍ | 846/2500 [00:38<01:13, 22.61it/s] 34%|███▍ | 849/2500 [00:38<01:13, 22.60it/s] 34%|███▍ | 852/2500 [00:38<01:12, 22.59it/s] 34%|███▍ | 855/2500 [00:38<01:12, 22.60it/s] 34%|███▍ | 858/2500 [00:38<01:13, 22.48it/s] 34%|███▍ | 861/2500 [00:38<01:12, 22.51it/s] 35%|███▍ | 864/2500 [00:38<01:12, 22.53it/s] 35%|███▍ | 867/2500 [00:39<01:12, 22.55it/s] 35%|███▍ | 870/2500 [00:39<01:12, 22.58it/s] 35%|███▍ | 873/2500 [00:39<01:12, 22.59it/s] 35%|███▌ | 876/2500 [00:39<01:11, 22.56it/s] 35%|███▌ | 879/2500 [00:39<01:11, 22.59it/s] 35%|███▌ | 882/2500 [00:39<01:11, 22.60it/s] 35%|███▌ | 885/2500 [00:39<01:11, 22.57it/s] 36%|███▌ | 888/2500 [00:40<01:11, 22.48it/s] 36%|███▌ | 891/2500 [00:40<01:11, 22.50it/s] 36%|███▌ | 894/2500 [00:40<01:11, 22.52it/s] 36%|███▌ | 897/2500 [00:40<01:11, 22.53it/s] 36%|███▌ | 900/2500 [00:40<01:10, 22.54it/s] 36%|███▌ | 903/2500 [00:40<01:10, 22.55it/s] 36%|███▌ | 906/2500 [00:40<01:10, 22.55it/s] 36%|███▋ | 909/2500 [00:40<01:10, 22.56it/s] 36%|███▋ | 912/2500 [00:41<01:10, 22.57it/s] 37%|███▋ | 915/2500 [00:41<01:10, 22.58it/s] 37%|███▋ | 918/2500 [00:41<01:10, 22.49it/s] 37%|███▋ | 921/2500 [00:41<01:10, 22.51it/s] 37%|███▋ | 924/2500 [00:41<01:09, 22.54it/s] 37%|███▋ | 927/2500 [00:41<01:09, 22.53it/s] 37%|███▋ | 930/2500 [00:41<01:09, 22.54it/s] 37%|███▋ | 933/2500 [00:42<01:09, 22.55it/s] 37%|███▋ | 936/2500 [00:42<01:09, 22.56it/s] 38%|███▊ | 939/2500 [00:42<01:09, 22.57it/s] 38%|███▊ | 942/2500 [00:42<01:08, 22.61it/s] 38%|███▊ | 945/2500 [00:42<01:08, 22.59it/s] 38%|███▊ | 948/2500 [00:42<01:08, 22.49it/s] 38%|███▊ | 951/2500 [00:42<01:08, 22.51it/s] 38%|███▊ | 954/2500 [00:42<01:08, 22.52it/s] 38%|███▊ | 957/2500 [00:43<01:08, 22.53it/s] 38%|███▊ | 960/2500 [00:43<01:08, 22.55it/s] 39%|███▊ | 963/2500 [00:43<01:08, 22.56it/s] 39%|███▊ | 966/2500 [00:43<01:07, 22.61it/s] 39%|███▉ | 969/2500 [00:43<01:07, 22.67it/s] 39%|███▉ | 972/2500 [00:43<01:07, 22.73it/s] 39%|███▉ | 975/2500 [00:43<01:07, 22.74it/s] 39%|███▉ | 978/2500 [00:44<01:07, 22.59it/s] 39%|███▉ | 981/2500 [00:44<01:07, 22.58it/s] 39%|███▉ | 984/2500 [00:44<01:07, 22.58it/s] 39%|███▉ | 987/2500 [00:44<01:07, 22.57it/s] 40%|███▉ | 990/2500 [00:44<01:06, 22.59it/s] 40%|███▉ | 993/2500 [00:44<01:06, 22.62it/s] 40%|███▉ | 996/2500 [00:44<01:06, 22.63it/s] 40%|███▉ | 999/2500 [00:44<01:06, 22.61it/s] 40%|████ | 1002/2500 [00:45<01:06, 22.62it/s] 40%|████ | 1005/2500 [00:45<01:06, 22.60it/s] 40%|████ | 1008/2500 [00:45<01:06, 22.53it/s] 40%|████ | 1011/2500 [00:45<01:06, 22.55it/s] 41%|████ | 1014/2500 [00:45<01:05, 22.57it/s] 41%|████ | 1017/2500 [00:45<01:05, 22.58it/s] 41%|████ | 1020/2500 [00:45<01:05, 22.56it/s] 41%|████ | 1023/2500 [00:46<01:05, 22.57it/s] 41%|████ | 1026/2500 [00:46<01:05, 22.57it/s] 41%|████ | 1029/2500 [00:46<01:05, 22.58it/s] 41%|████▏ | 1032/2500 [00:46<01:04, 22.60it/s] 41%|████▏ | 1035/2500 [00:46<01:04, 22.58it/s] 42%|████▏ | 1038/2500 [00:46<01:04, 22.49it/s] 42%|████▏ | 1041/2500 [00:46<01:04, 22.51it/s] 42%|████▏ | 1044/2500 [00:46<01:04, 22.52it/s] 42%|████▏ | 1047/2500 [00:47<01:04, 22.52it/s] 42%|████▏ | 1050/2500 [00:47<01:04, 22.54it/s] 42%|████▏ | 1053/2500 [00:47<01:03, 22.62it/s] 42%|████▏ | 1056/2500 [00:47<01:03, 22.71it/s] 42%|████▏ | 1059/2500 [00:47<01:03, 22.78it/s] 42%|████▏ | 1062/2500 [00:47<01:03, 22.83it/s] 43%|████▎ | 1065/2500 [00:47<01:02, 22.85it/s] 43%|████▎ | 1068/2500 [00:48<01:02, 22.87it/s] 43%|████▎ | 1071/2500 [00:48<01:02, 22.77it/s] 43%|████▎ | 1074/2500 [00:48<01:02, 22.80it/s] 43%|████▎ | 1077/2500 [00:48<01:02, 22.81it/s] 43%|████▎ | 1080/2500 [00:48<01:02, 22.79it/s] 43%|████▎ | 1083/2500 [00:48<01:02, 22.72it/s] 43%|████▎ | 1086/2500 [00:48<01:02, 22.69it/s] 44%|████▎ | 1089/2500 [00:48<01:02, 22.65it/s] 44%|████▎ | 1092/2500 [00:49<01:02, 22.63it/s] 44%|████▍ | 1095/2500 [00:49<01:02, 22.61it/s] 44%|████▍ | 1098/2500 [00:49<01:02, 22.60it/s] 44%|████▍ | 1101/2500 [00:49<01:02, 22.50it/s] 44%|████▍ | 1104/2500 [00:49<01:01, 22.54it/s] 44%|████▍ | 1107/2500 [00:49<01:01, 22.64it/s] 44%|████▍ | 1110/2500 [00:49<01:01, 22.68it/s] 45%|████▍ | 1113/2500 [00:49<01:01, 22.69it/s] 45%|████▍ | 1116/2500 [00:50<01:01, 22.66it/s] 45%|████▍ | 1119/2500 [00:50<01:01, 22.63it/s] 45%|████▍ | 1122/2500 [00:50<01:00, 22.63it/s] 45%|████▌ | 1125/2500 [00:50<01:00, 22.58it/s] 45%|████▌ | 1128/2500 [00:50<01:00, 22.58it/s] 45%|████▌ | 1131/2500 [00:50<01:00, 22.47it/s] 45%|████▌ | 1134/2500 [00:50<01:00, 22.49it/s] 45%|████▌ | 1137/2500 [00:51<01:00, 22.50it/s] 46%|████▌ | 1140/2500 [00:51<01:00, 22.52it/s] 46%|████▌ | 1143/2500 [00:51<01:00, 22.53it/s] 46%|████▌ | 1146/2500 [00:51<01:00, 22.54it/s] 46%|████▌ | 1149/2500 [00:51<00:59, 22.53it/s] 46%|████▌ | 1152/2500 [00:51<00:59, 22.52it/s] 46%|████▌ | 1155/2500 [00:51<00:59, 22.53it/s] 46%|████▋ | 1158/2500 [00:51<00:59, 22.55it/s] 46%|████▋ | 1161/2500 [00:52<00:59, 22.44it/s] 47%|████▋ | 1164/2500 [00:52<00:59, 22.46it/s] 47%|████▋ | 1167/2500 [00:52<00:59, 22.53it/s] 47%|████▋ | 1170/2500 [00:52<00:58, 22.56it/s] 47%|████▋ | 1173/2500 [00:52<00:58, 22.56it/s] 47%|████▋ | 1176/2500 [00:52<00:58, 22.57it/s] 47%|████▋ | 1179/2500 [00:52<00:58, 22.55it/s] 47%|████▋ | 1182/2500 [00:53<00:58, 22.54it/s] 47%|████▋ | 1185/2500 [00:53<00:58, 22.54it/s] 48%|████▊ | 1188/2500 [00:53<00:58, 22.55it/s] 48%|████▊ | 1191/2500 [00:53<00:58, 22.46it/s] 48%|████▊ | 1194/2500 [00:53<00:58, 22.47it/s] 48%|████▊ | 1197/2500 [00:53<00:57, 22.51it/s] 48%|████▊ | 1200/2500 [00:53<00:57, 22.52it/s] 48%|████▊ | 1203/2500 [00:53<00:57, 22.53it/s] 48%|████▊ | 1206/2500 [00:54<00:57, 22.54it/s] 48%|████▊ | 1209/2500 [00:54<00:57, 22.56it/s] 48%|████▊ | 1212/2500 [00:54<00:57, 22.56it/s] 49%|████▊ | 1215/2500 [00:54<00:56, 22.55it/s] 49%|████▊ | 1218/2500 [00:54<00:56, 22.54it/s] 49%|████▉ | 1221/2500 [00:54<00:56, 22.45it/s] 49%|████▉ | 1224/2500 [00:54<00:56, 22.48it/s] 49%|████▉ | 1227/2500 [00:55<00:56, 22.51it/s] 49%|████▉ | 1230/2500 [00:55<00:56, 22.53it/s] 49%|████▉ | 1233/2500 [00:55<00:56, 22.52it/s] 49%|████▉ | 1236/2500 [00:55<00:56, 22.52it/s] 50%|████▉ | 1239/2500 [00:55<00:55, 22.54it/s] 50%|████▉ | 1242/2500 [00:55<00:55, 22.55it/s] 50%|████▉ | 1245/2500 [00:55<00:55, 22.56it/s] 50%|████▉ | 1248/2500 [00:55<00:55, 22.57it/s] 50%|█████ | 1251/2500 [00:56<00:55, 22.50it/s] 50%|█████ | 1254/2500 [00:56<00:55, 22.53it/s] 50%|█████ | 1257/2500 [00:56<00:55, 22.52it/s] 50%|█████ | 1260/2500 [00:56<00:55, 22.53it/s] 51%|█████ | 1263/2500 [00:56<00:54, 22.52it/s] 51%|█████ | 1266/2500 [00:56<00:54, 22.52it/s] 51%|█████ | 1269/2500 [00:56<00:54, 22.53it/s] 51%|█████ | 1272/2500 [00:57<00:54, 22.54it/s] 51%|█████ | 1275/2500 [00:57<00:54, 22.55it/s] 51%|█████ | 1278/2500 [00:57<00:54, 22.56it/s] 51%|█████ | 1281/2500 [00:57<00:54, 22.49it/s] 51%|█████▏ | 1284/2500 [00:57<00:54, 22.49it/s] 51%|█████▏ | 1287/2500 [00:57<00:53, 22.51it/s] 52%|█████▏ | 1290/2500 [00:57<00:53, 22.50it/s] 52%|█████▏ | 1293/2500 [00:57<00:53, 22.54it/s] 52%|█████▏ | 1296/2500 [00:58<00:53, 22.56it/s] 52%|█████▏ | 1299/2500 [00:58<00:53, 22.56it/s] 52%|█████▏ | 1302/2500 [00:58<00:53, 22.55it/s] 52%|█████▏ | 1305/2500 [00:58<00:53, 22.54it/s] 52%|█████▏ | 1308/2500 [00:58<00:52, 22.55it/s] 52%|█████▏ | 1311/2500 [00:58<00:52, 22.44it/s] 53%|█████▎ | 1314/2500 [00:58<00:52, 22.50it/s] 53%|█████▎ | 1317/2500 [00:59<00:52, 22.52it/s] 53%|█████▎ | 1320/2500 [00:59<00:52, 22.53it/s] 53%|█████▎ | 1323/2500 [00:59<00:52, 22.54it/s] 53%|█████▎ | 1326/2500 [00:59<00:52, 22.54it/s] 53%|█████▎ | 1329/2500 [00:59<00:51, 22.54it/s] 53%|█████▎ | 1332/2500 [00:59<00:51, 22.54it/s] 53%|█████▎ | 1335/2500 [00:59<00:51, 22.54it/s] 54%|█████▎ | 1338/2500 [00:59<00:51, 22.54it/s] 54%|█████▎ | 1341/2500 [01:00<00:51, 22.47it/s] 54%|█████▍ | 1344/2500 [01:00<00:51, 22.48it/s] 54%|█████▍ | 1347/2500 [01:00<00:51, 22.49it/s] 54%|█████▍ | 1350/2500 [01:00<00:51, 22.49it/s] 54%|█████▍ | 1353/2500 [01:00<00:50, 22.51it/s] 54%|█████▍ | 1356/2500 [01:00<00:50, 22.52it/s] 54%|█████▍ | 1359/2500 [01:00<00:50, 22.52it/s] 54%|█████▍ | 1362/2500 [01:01<00:50, 22.52it/s] 55%|█████▍ | 1365/2500 [01:01<00:50, 22.52it/s] 55%|█████▍ | 1368/2500 [01:01<00:50, 22.54it/s] 55%|█████▍ | 1371/2500 [01:01<00:50, 22.42it/s] 55%|█████▍ | 1374/2500 [01:01<00:50, 22.45it/s] 55%|█████▌ | 1377/2500 [01:01<00:49, 22.47it/s] 55%|█████▌ | 1380/2500 [01:01<00:49, 22.49it/s] 55%|█████▌ | 1383/2500 [01:01<00:49, 22.51it/s] 55%|█████▌ | 1386/2500 [01:02<00:49, 22.51it/s] 56%|█████▌ | 1389/2500 [01:02<00:49, 22.52it/s] 56%|█████▌ | 1392/2500 [01:02<00:49, 22.56it/s] 56%|█████▌ | 1395/2500 [01:02<00:48, 22.58it/s] 56%|█████▌ | 1398/2500 [01:02<00:48, 22.58it/s] 56%|█████▌ | 1401/2500 [01:02<00:48, 22.46it/s] 56%|█████▌ | 1404/2500 [01:02<00:48, 22.48it/s] 56%|█████▋ | 1407/2500 [01:03<00:48, 22.50it/s] 56%|█████▋ | 1410/2500 [01:03<00:48, 22.50it/s] 57%|█████▋ | 1413/2500 [01:03<00:48, 22.51it/s] 57%|█████▋ | 1416/2500 [01:03<00:48, 22.53it/s] 57%|█████▋ | 1419/2500 [01:03<00:47, 22.54it/s] 57%|█████▋ | 1422/2500 [01:03<00:47, 22.54it/s] 57%|█████▋ | 1425/2500 [01:03<00:47, 22.56it/s] 57%|█████▋ | 1428/2500 [01:03<00:47, 22.56it/s] 57%|█████▋ | 1431/2500 [01:04<00:47, 22.55it/s] 57%|█████▋ | 1434/2500 [01:04<00:47, 22.47it/s] 57%|█████▋ | 1437/2500 [01:04<00:47, 22.48it/s] 58%|█████▊ | 1440/2500 [01:04<00:47, 22.50it/s] 58%|█████▊ | 1443/2500 [01:04<00:46, 22.62it/s] 58%|█████▊ | 1446/2500 [01:04<00:46, 22.73it/s] 58%|█████▊ | 1449/2500 [01:04<00:46, 22.80it/s] 58%|█████▊ | 1452/2500 [01:05<00:45, 22.84it/s] 58%|█████▊ | 1455/2500 [01:05<00:45, 22.86it/s] 58%|█████▊ | 1458/2500 [01:05<00:45, 22.89it/s] 58%|█████▊ | 1461/2500 [01:05<00:45, 22.91it/s] 59%|█████▊ | 1464/2500 [01:05<00:45, 22.83it/s] 59%|█████▊ | 1467/2500 [01:05<00:45, 22.87it/s] 59%|█████▉ | 1470/2500 [01:05<00:44, 22.89it/s] 59%|█████▉ | 1473/2500 [01:05<00:44, 22.90it/s] 59%|█████▉ | 1476/2500 [01:06<00:44, 22.91it/s] 59%|█████▉ | 1479/2500 [01:06<00:44, 22.93it/s] 59%|█████▉ | 1482/2500 [01:06<00:44, 22.94it/s] 59%|█████▉ | 1485/2500 [01:06<00:44, 22.97it/s] 60%|█████▉ | 1488/2500 [01:06<00:44, 22.98it/s] 60%|█████▉ | 1491/2500 [01:06<00:43, 22.99it/s] 60%|█████▉ | 1494/2500 [01:06<00:43, 22.88it/s] 60%|█████▉ | 1497/2500 [01:06<00:43, 22.92it/s] 60%|██████ | 1500/2500 [01:07<00:43, 22.94it/s] 60%|██████ | 1503/2500 [01:07<00:43, 22.95it/s] 60%|██████ | 1506/2500 [01:07<00:43, 22.96it/s] 60%|██████ | 1509/2500 [01:07<00:43, 22.97it/s] 60%|██████ | 1512/2500 [01:07<00:43, 22.93it/s] 61%|██████ | 1515/2500 [01:07<00:42, 22.95it/s] 61%|██████ | 1518/2500 [01:07<00:42, 22.94it/s] 61%|██████ | 1521/2500 [01:08<00:42, 22.93it/s] 61%|██████ | 1524/2500 [01:08<00:42, 22.83it/s] 61%|██████ | 1527/2500 [01:08<00:42, 22.86it/s] 61%|██████ | 1530/2500 [01:08<00:42, 22.90it/s] 61%|██████▏ | 1533/2500 [01:08<00:42, 22.93it/s] 61%|██████▏ | 1536/2500 [01:08<00:42, 22.93it/s] 62%|██████▏ | 1539/2500 [01:08<00:41, 22.94it/s] 62%|██████▏ | 1542/2500 [01:08<00:41, 22.95it/s] 62%|██████▏ | 1545/2500 [01:09<00:41, 22.96it/s] 62%|██████▏ | 1548/2500 [01:09<00:41, 22.93it/s] 62%|██████▏ | 1551/2500 [01:09<00:41, 22.95it/s] 62%|██████▏ | 1554/2500 [01:09<00:41, 22.83it/s] 62%|██████▏ | 1557/2500 [01:09<00:41, 22.89it/s] 62%|██████▏ | 1560/2500 [01:09<00:41, 22.89it/s] 63%|██████▎ | 1563/2500 [01:09<00:40, 22.91it/s] 63%|██████▎ | 1566/2500 [01:10<00:40, 22.94it/s] 63%|██████▎ | 1569/2500 [01:10<00:40, 22.95it/s] 63%|██████▎ | 1572/2500 [01:10<00:40, 22.94it/s] 63%|██████▎ | 1575/2500 [01:10<00:40, 22.94it/s] 63%|██████▎ | 1578/2500 [01:10<00:40, 22.95it/s] 63%|██████▎ | 1581/2500 [01:10<00:40, 22.94it/s] 63%|██████▎ | 1584/2500 [01:10<00:39, 22.95it/s] 63%|██████▎ | 1587/2500 [01:10<00:39, 22.85it/s] 64%|██████▎ | 1590/2500 [01:11<00:39, 22.90it/s] 64%|██████▎ | 1593/2500 [01:11<00:39, 22.91it/s] 64%|██████▍ | 1596/2500 [01:11<00:39, 22.92it/s] 64%|██████▍ | 1599/2500 [01:11<00:39, 22.93it/s] 64%|██████▍ | 1602/2500 [01:11<00:39, 22.93it/s] 64%|██████▍ | 1605/2500 [01:11<00:38, 22.95it/s] 64%|██████▍ | 1608/2500 [01:11<00:38, 22.96it/s] 64%|██████▍ | 1611/2500 [01:11<00:38, 22.96it/s] 65%|██████▍ | 1614/2500 [01:12<00:38, 22.98it/s] 65%|██████▍ | 1617/2500 [01:12<00:38, 22.87it/s] 65%|██████▍ | 1620/2500 [01:12<00:38, 22.87it/s] 65%|██████▍ | 1623/2500 [01:12<00:38, 22.90it/s] 65%|██████▌ | 1626/2500 [01:12<00:38, 22.92it/s] 65%|██████▌ | 1629/2500 [01:12<00:38, 22.92it/s] 65%|██████▌ | 1632/2500 [01:12<00:37, 22.93it/s] 65%|██████▌ | 1635/2500 [01:13<00:37, 22.93it/s] 66%|██████▌ | 1638/2500 [01:13<00:37, 22.93it/s] 66%|██████▌ | 1641/2500 [01:13<00:37, 22.93it/s] 66%|██████▌ | 1644/2500 [01:13<00:37, 22.93it/s] 66%|██████▌ | 1647/2500 [01:13<00:37, 22.82it/s] 66%|██████▌ | 1650/2500 [01:13<00:37, 22.86it/s] 66%|██████▌ | 1653/2500 [01:13<00:37, 22.89it/s] 66%|██████▌ | 1656/2500 [01:13<00:36, 22.90it/s] 66%|██████▋ | 1659/2500 [01:14<00:36, 22.92it/s] 66%|██████▋ | 1662/2500 [01:14<00:36, 22.94it/s] 67%|██████▋ | 1665/2500 [01:14<00:36, 22.94it/s] 67%|██████▋ | 1668/2500 [01:14<00:36, 22.95it/s] 67%|██████▋ | 1671/2500 [01:14<00:36, 22.95it/s] 67%|██████▋ | 1674/2500 [01:14<00:35, 22.96it/s] 67%|██████▋ | 1677/2500 [01:14<00:36, 22.86it/s] 67%|██████▋ | 1680/2500 [01:14<00:35, 22.88it/s] 67%|██████▋ | 1683/2500 [01:15<00:35, 22.91it/s] 67%|██████▋ | 1686/2500 [01:15<00:35, 22.92it/s] 68%|██████▊ | 1689/2500 [01:15<00:35, 22.94it/s] 68%|██████▊ | 1692/2500 [01:15<00:35, 22.94it/s] 68%|██████▊ | 1695/2500 [01:15<00:35, 22.94it/s] 68%|██████▊ | 1698/2500 [01:15<00:34, 22.95it/s] 68%|██████▊ | 1701/2500 [01:15<00:34, 22.93it/s] 68%|██████▊ | 1704/2500 [01:16<00:34, 22.94it/s] 68%|██████▊ | 1707/2500 [01:16<00:34, 22.96it/s] 68%|██████▊ | 1710/2500 [01:16<00:34, 22.85it/s] 69%|██████▊ | 1713/2500 [01:16<00:34, 22.86it/s] 69%|██████▊ | 1716/2500 [01:16<00:34, 22.90it/s] 69%|██████▉ | 1719/2500 [01:16<00:34, 22.91it/s] 69%|██████▉ | 1722/2500 [01:16<00:33, 22.92it/s] 69%|██████▉ | 1725/2500 [01:16<00:33, 22.92it/s] 69%|██████▉ | 1728/2500 [01:17<00:33, 22.94it/s] 69%|██████▉ | 1731/2500 [01:17<00:33, 22.94it/s] 69%|██████▉ | 1734/2500 [01:17<00:33, 22.94it/s] 69%|██████▉ | 1737/2500 [01:17<00:33, 22.97it/s] 70%|██████▉ | 1740/2500 [01:17<00:33, 22.88it/s] 70%|██████▉ | 1743/2500 [01:17<00:33, 22.89it/s] 70%|██████▉ | 1746/2500 [01:17<00:32, 22.91it/s] 70%|██████▉ | 1749/2500 [01:17<00:32, 22.90it/s] 70%|███████ | 1752/2500 [01:18<00:32, 22.90it/s] 70%|███████ | 1755/2500 [01:18<00:32, 22.92it/s] 70%|███████ | 1758/2500 [01:18<00:32, 22.93it/s] 70%|███████ | 1761/2500 [01:18<00:32, 22.93it/s] 71%|███████ | 1764/2500 [01:18<00:32, 22.94it/s] 71%|███████ | 1767/2500 [01:18<00:31, 22.92it/s] 71%|███████ | 1770/2500 [01:18<00:31, 22.82it/s] 71%|███████ | 1773/2500 [01:19<00:31, 22.85it/s] 71%|███████ | 1776/2500 [01:19<00:31, 22.87it/s] 71%|███████ | 1779/2500 [01:19<00:31, 22.88it/s] 71%|███████▏ | 1782/2500 [01:19<00:31, 22.90it/s] 71%|███████▏ | 1785/2500 [01:19<00:31, 22.93it/s] 72%|███████▏ | 1788/2500 [01:19<00:31, 22.92it/s] 72%|███████▏ | 1791/2500 [01:19<00:30, 22.93it/s] 72%|███████▏ | 1794/2500 [01:19<00:30, 22.92it/s] 72%|███████▏ | 1797/2500 [01:20<00:30, 22.93it/s] 72%|███████▏ | 1800/2500 [01:20<00:30, 22.82it/s] 72%|███████▏ | 1803/2500 [01:20<00:30, 22.84it/s] 72%|███████▏ | 1806/2500 [01:20<00:30, 22.86it/s] 72%|███████▏ | 1809/2500 [01:20<00:30, 22.89it/s] 72%|███████▏ | 1812/2500 [01:20<00:30, 22.92it/s] 73%|███████▎ | 1815/2500 [01:20<00:29, 22.94it/s] 73%|███████▎ | 1818/2500 [01:21<00:29, 22.93it/s] 73%|███████▎ | 1821/2500 [01:21<00:29, 22.93it/s] 73%|███████▎ | 1824/2500 [01:21<00:29, 22.94it/s] 73%|███████▎ | 1827/2500 [01:21<00:29, 22.94it/s] 73%|███████▎ | 1830/2500 [01:21<00:29, 22.94it/s] 73%|███████▎ | 1833/2500 [01:21<00:29, 22.82it/s] 73%|███████▎ | 1836/2500 [01:21<00:29, 22.84it/s] 74%|███████▎ | 1839/2500 [01:21<00:28, 22.87it/s] 74%|███████▎ | 1842/2500 [01:22<00:28, 22.89it/s] 74%|███████▍ | 1845/2500 [01:22<00:28, 22.90it/s] 74%|███████▍ | 1848/2500 [01:22<00:28, 22.90it/s] 74%|███████▍ | 1851/2500 [01:22<00:28, 22.90it/s] 74%|███████▍ | 1854/2500 [01:22<00:28, 22.90it/s] 74%|███████▍ | 1857/2500 [01:22<00:28, 22.92it/s] 74%|███████▍ | 1860/2500 [01:22<00:27, 22.93it/s] 75%|███████▍ | 1863/2500 [01:22<00:27, 22.81it/s] 75%|███████▍ | 1866/2500 [01:23<00:27, 22.86it/s] 75%|███████▍ | 1869/2500 [01:23<00:27, 22.89it/s] 75%|███████▍ | 1872/2500 [01:23<00:27, 22.91it/s] 75%|███████▌ | 1875/2500 [01:23<00:27, 22.93it/s] 75%|███████▌ | 1878/2500 [01:23<00:27, 22.95it/s] 75%|███████▌ | 1881/2500 [01:23<00:26, 22.94it/s] 75%|███████▌ | 1884/2500 [01:23<00:26, 22.93it/s] 75%|███████▌ | 1887/2500 [01:24<00:26, 22.93it/s] 76%|███████▌ | 1890/2500 [01:24<00:26, 22.92it/s] 76%|███████▌ | 1893/2500 [01:24<00:26, 22.83it/s] 76%|███████▌ | 1896/2500 [01:24<00:26, 22.87it/s] 76%|███████▌ | 1899/2500 [01:24<00:26, 22.90it/s] 76%|███████▌ | 1902/2500 [01:24<00:26, 22.92it/s] 76%|███████▌ | 1905/2500 [01:24<00:25, 22.93it/s] 76%|███████▋ | 1908/2500 [01:24<00:25, 22.92it/s] 76%|███████▋ | 1911/2500 [01:25<00:25, 22.94it/s] 77%|███████▋ | 1914/2500 [01:25<00:25, 22.93it/s] 77%|███████▋ | 1917/2500 [01:25<00:25, 22.94it/s] 77%|███████▋ | 1920/2500 [01:25<00:25, 22.94it/s] 77%|███████▋ | 1923/2500 [01:25<00:25, 22.83it/s] 77%|███████▋ | 1926/2500 [01:25<00:25, 22.86it/s] 77%|███████▋ | 1929/2500 [01:25<00:24, 22.87it/s] 77%|███████▋ | 1932/2500 [01:25<00:24, 22.89it/s] 77%|███████▋ | 1935/2500 [01:26<00:24, 22.91it/s] 78%|███████▊ | 1938/2500 [01:26<00:24, 22.93it/s] 78%|███████▊ | 1941/2500 [01:26<00:24, 22.92it/s] 78%|███████▊ | 1944/2500 [01:26<00:24, 22.93it/s] 78%|███████▊ | 1947/2500 [01:26<00:24, 22.94it/s] 78%|███████▊ | 1950/2500 [01:26<00:23, 22.93it/s] 78%|███████▊ | 1953/2500 [01:26<00:23, 22.95it/s] 78%|███████▊ | 1956/2500 [01:27<00:23, 22.85it/s] 78%|███████▊ | 1959/2500 [01:27<00:23, 22.88it/s] 78%|███████▊ | 1962/2500 [01:27<00:23, 22.92it/s] 79%|███████▊ | 1965/2500 [01:27<00:23, 22.93it/s] 79%|███████▊ | 1968/2500 [01:27<00:23, 22.91it/s] 79%|███████▉ | 1971/2500 [01:27<00:23, 22.91it/s] 79%|███████▉ | 1974/2500 [01:27<00:22, 22.91it/s] 79%|███████▉ | 1977/2500 [01:27<00:22, 22.91it/s] 79%|███████▉ | 1980/2500 [01:28<00:22, 22.92it/s] 79%|███████▉ | 1983/2500 [01:28<00:22, 22.93it/s] 79%|███████▉ | 1986/2500 [01:28<00:22, 22.81it/s] 80%|███████▉ | 1989/2500 [01:28<00:22, 22.86it/s] 80%|███████▉ | 1992/2500 [01:28<00:22, 22.88it/s] 80%|███████▉ | 1995/2500 [01:28<00:22, 22.90it/s] 80%|███████▉ | 1998/2500 [01:28<00:21, 22.92it/s] 80%|████████ | 2001/2500 [01:28<00:21, 22.94it/s] 80%|████████ | 2004/2500 [01:29<00:21, 22.93it/s] 80%|████████ | 2007/2500 [01:29<00:21, 22.93it/s] 80%|████████ | 2010/2500 [01:29<00:21, 22.93it/s] 81%|████████ | 2013/2500 [01:29<00:21, 22.94it/s] 81%|████████ | 2016/2500 [01:29<00:21, 22.84it/s] 81%|████████ | 2019/2500 [01:29<00:21, 22.86it/s] 81%|████████ | 2022/2500 [01:29<00:20, 22.89it/s] 81%|████████ | 2025/2500 [01:30<00:20, 22.91it/s] 81%|████████ | 2028/2500 [01:30<00:20, 22.91it/s] 81%|████████ | 2031/2500 [01:30<00:20, 22.93it/s] 81%|████████▏ | 2034/2500 [01:30<00:20, 22.93it/s] 81%|████████▏ | 2037/2500 [01:30<00:20, 22.94it/s] 82%|████████▏ | 2040/2500 [01:30<00:20, 22.92it/s] 82%|████████▏ | 2043/2500 [01:30<00:19, 22.92it/s] 82%|████████▏ | 2046/2500 [01:30<00:19, 22.82it/s] 82%|████████▏ | 2049/2500 [01:31<00:19, 22.85it/s] 82%|████████▏ | 2052/2500 [01:31<00:19, 22.89it/s] 82%|████████▏ | 2055/2500 [01:31<00:19, 22.90it/s] 82%|████████▏ | 2058/2500 [01:31<00:19, 22.92it/s] 82%|████████▏ | 2061/2500 [01:31<00:19, 22.94it/s] 83%|████████▎ | 2064/2500 [01:31<00:19, 22.94it/s] 83%|████████▎ | 2067/2500 [01:31<00:18, 22.94it/s] 83%|████████▎ | 2070/2500 [01:32<00:18, 22.92it/s] 83%|████████▎ | 2073/2500 [01:32<00:18, 22.91it/s] 83%|████████▎ | 2076/2500 [01:32<00:18, 22.92it/s] 83%|████████▎ | 2079/2500 [01:32<00:18, 22.80it/s] 83%|████████▎ | 2082/2500 [01:32<00:18, 22.84it/s] 83%|████████▎ | 2085/2500 [01:32<00:18, 22.87it/s] 84%|████████▎ | 2088/2500 [01:32<00:17, 22.89it/s] 84%|████████▎ | 2091/2500 [01:32<00:17, 22.88it/s] 84%|████████▍ | 2094/2500 [01:33<00:17, 22.91it/s] 84%|████████▍ | 2097/2500 [01:33<00:17, 22.93it/s] 84%|████████▍ | 2100/2500 [01:33<00:17, 22.94it/s] 84%|████████▍ | 2103/2500 [01:33<00:17, 22.94it/s] 84%|████████▍ | 2106/2500 [01:33<00:17, 22.94it/s] 84%|████████▍ | 2109/2500 [01:33<00:17, 22.82it/s] 84%|████████▍ | 2112/2500 [01:33<00:16, 22.85it/s] 85%|████████▍ | 2115/2500 [01:33<00:16, 22.87it/s] 85%|████████▍ | 2118/2500 [01:34<00:16, 22.88it/s] 85%|████████▍ | 2121/2500 [01:34<00:16, 22.88it/s] 85%|████████▍ | 2124/2500 [01:34<00:16, 22.89it/s] 85%|████████▌ | 2127/2500 [01:34<00:16, 22.89it/s] 85%|████████▌ | 2130/2500 [01:34<00:16, 22.91it/s] 85%|████████▌ | 2133/2500 [01:34<00:16, 22.92it/s] 85%|████████▌ | 2136/2500 [01:34<00:15, 22.93it/s] 86%|████████▌ | 2139/2500 [01:35<00:15, 22.83it/s] 86%|████████▌ | 2142/2500 [01:35<00:15, 22.86it/s] 86%|████████▌ | 2145/2500 [01:35<00:15, 22.88it/s] 86%|████████▌ | 2148/2500 [01:35<00:15, 22.91it/s] 86%|████████▌ | 2151/2500 [01:35<00:15, 22.91it/s] 86%|████████▌ | 2154/2500 [01:35<00:15, 22.93it/s] 86%|████████▋ | 2157/2500 [01:35<00:14, 22.94it/s] 86%|████████▋ | 2160/2500 [01:35<00:14, 22.95it/s] 87%|████████▋ | 2163/2500 [01:36<00:14, 22.95it/s] 87%|████████▋ | 2166/2500 [01:36<00:14, 22.92it/s] 87%|████████▋ | 2169/2500 [01:36<00:14, 22.83it/s] 87%|████████▋ | 2172/2500 [01:36<00:14, 22.85it/s] 87%|████████▋ | 2175/2500 [01:36<00:14, 22.88it/s] 87%|████████▋ | 2178/2500 [01:36<00:14, 22.90it/s] 87%|████████▋ | 2181/2500 [01:36<00:13, 22.91it/s] 87%|████████▋ | 2184/2500 [01:36<00:13, 22.90it/s] 87%|████████▋ | 2187/2500 [01:37<00:13, 22.92it/s] 88%|████████▊ | 2190/2500 [01:37<00:13, 22.92it/s] 88%|████████▊ | 2193/2500 [01:37<00:13, 22.93it/s] 88%|████████▊ | 2196/2500 [01:37<00:13, 22.94it/s] 88%|████████▊ | 2199/2500 [01:37<00:13, 22.82it/s] 88%|████████▊ | 2202/2500 [01:37<00:13, 22.86it/s] 88%|████████▊ | 2205/2500 [01:37<00:12, 22.89it/s] 88%|████████▊ | 2208/2500 [01:38<00:12, 22.92it/s] 88%|████████▊ | 2211/2500 [01:38<00:12, 22.92it/s] 89%|████████▊ | 2214/2500 [01:38<00:12, 22.92it/s] 89%|████████▊ | 2217/2500 [01:38<00:12, 22.91it/s] 89%|████████▉ | 2220/2500 [01:38<00:12, 22.92it/s] 89%|████████▉ | 2223/2500 [01:38<00:12, 22.93it/s] 89%|████████▉ | 2226/2500 [01:38<00:11, 22.93it/s] 89%|████████▉ | 2229/2500 [01:38<00:11, 22.94it/s] 89%|████████▉ | 2232/2500 [01:39<00:11, 22.84it/s] 89%|████████▉ | 2235/2500 [01:39<00:11, 22.86it/s] 90%|████████▉ | 2238/2500 [01:39<00:11, 22.88it/s] 90%|████████▉ | 2241/2500 [01:39<00:11, 22.89it/s] 90%|████████▉ | 2244/2500 [01:39<00:11, 22.90it/s] 90%|████████▉ | 2247/2500 [01:39<00:11, 22.91it/s] 90%|█████████ | 2250/2500 [01:39<00:10, 22.91it/s] 90%|█████████ | 2253/2500 [01:39<00:10, 22.92it/s] 90%|█████████ | 2256/2500 [01:40<00:10, 22.93it/s] 90%|█████████ | 2259/2500 [01:40<00:10, 22.93it/s] 90%|█████████ | 2262/2500 [01:40<00:10, 22.83it/s] 91%|█████████ | 2265/2500 [01:40<00:10, 22.84it/s] 91%|█████████ | 2268/2500 [01:40<00:10, 22.87it/s] 91%|█████████ | 2271/2500 [01:40<00:10, 22.89it/s] 91%|█████████ | 2274/2500 [01:40<00:09, 22.91it/s] 91%|█████████ | 2277/2500 [01:41<00:09, 22.92it/s] 91%|█████████ | 2280/2500 [01:41<00:09, 22.93it/s] 91%|█████████▏| 2283/2500 [01:41<00:09, 22.92it/s] 91%|█████████▏| 2286/2500 [01:41<00:09, 22.93it/s] 92%|█████████▏| 2289/2500 [01:41<00:09, 22.93it/s] 92%|█████████▏| 2292/2500 [01:41<00:09, 22.82it/s] 92%|█████████▏| 2295/2500 [01:41<00:08, 22.85it/s] 92%|█████████▏| 2298/2500 [01:41<00:08, 22.88it/s] 92%|█████████▏| 2301/2500 [01:42<00:08, 22.88it/s] 92%|█████████▏| 2304/2500 [01:42<00:08, 22.92it/s] 92%|█████████▏| 2307/2500 [01:42<00:08, 22.92it/s] 92%|█████████▏| 2310/2500 [01:42<00:08, 22.91it/s] 93%|█████████▎| 2313/2500 [01:42<00:08, 22.92it/s] 93%|█████████▎| 2316/2500 [01:42<00:08, 22.93it/s] 93%|█████████▎| 2319/2500 [01:42<00:07, 22.93it/s] 93%|█████████▎| 2322/2500 [01:43<00:07, 22.80it/s] 93%|█████████▎| 2325/2500 [01:43<00:07, 22.84it/s] 93%|█████████▎| 2328/2500 [01:43<00:07, 22.88it/s] 93%|█████████▎| 2331/2500 [01:43<00:07, 22.90it/s] 93%|█████████▎| 2334/2500 [01:43<00:07, 22.91it/s] 93%|█████████▎| 2337/2500 [01:43<00:07, 22.91it/s] 94%|█████████▎| 2340/2500 [01:43<00:06, 22.90it/s] 94%|█████████▎| 2343/2500 [01:43<00:06, 22.90it/s] 94%|█████████▍| 2346/2500 [01:44<00:06, 22.90it/s] 94%|█████████▍| 2349/2500 [01:44<00:06, 22.92it/s] 94%|█████████▍| 2352/2500 [01:44<00:06, 22.93it/s] 94%|█████████▍| 2355/2500 [01:44<00:06, 22.82it/s] 94%|█████████▍| 2358/2500 [01:44<00:06, 22.85it/s] 94%|█████████▍| 2361/2500 [01:44<00:06, 22.87it/s] 95%|█████████▍| 2364/2500 [01:44<00:05, 22.88it/s] 95%|█████████▍| 2367/2500 [01:44<00:05, 22.90it/s] 95%|█████████▍| 2370/2500 [01:45<00:05, 22.93it/s] 95%|█████████▍| 2373/2500 [01:45<00:05, 22.94it/s] 95%|█████████▌| 2376/2500 [01:45<00:05, 22.95it/s] 95%|█████████▌| 2379/2500 [01:45<00:05, 22.94it/s] 95%|█████████▌| 2382/2500 [01:45<00:05, 22.94it/s] 95%|█████████▌| 2385/2500 [01:45<00:05, 22.82it/s] 96%|█████████▌| 2388/2500 [01:45<00:04, 22.87it/s] 96%|█████████▌| 2391/2500 [01:46<00:04, 22.88it/s] 96%|█████████▌| 2394/2500 [01:46<00:04, 22.89it/s] 96%|█████████▌| 2397/2500 [01:46<00:04, 22.90it/s] 96%|█████████▌| 2400/2500 [01:46<00:04, 22.88it/s] 96%|█████████▌| 2403/2500 [01:46<00:04, 22.91it/s] 96%|█████████▌| 2406/2500 [01:46<00:04, 22.89it/s] 96%|█████████▋| 2409/2500 [01:46<00:03, 22.90it/s] 96%|█████████▋| 2412/2500 [01:46<00:03, 22.90it/s] 97%|█████████▋| 2415/2500 [01:47<00:03, 22.80it/s] 97%|█████████▋| 2418/2500 [01:47<00:03, 22.84it/s] 97%|█████████▋| 2421/2500 [01:47<00:03, 22.87it/s] 97%|█████████▋| 2424/2500 [01:47<00:03, 22.89it/s] 97%|█████████▋| 2427/2500 [01:47<00:03, 22.88it/s] 97%|█████████▋| 2430/2500 [01:47<00:03, 22.89it/s] 97%|█████████▋| 2433/2500 [01:47<00:02, 22.92it/s] 97%|█████████▋| 2436/2500 [01:47<00:02, 22.91it/s] 98%|█████████▊| 2439/2500 [01:48<00:02, 22.91it/s] 98%|█████████▊| 2442/2500 [01:48<00:02, 22.91it/s] 98%|█████████▊| 2445/2500 [01:48<00:02, 22.82it/s] 98%|█████████▊| 2448/2500 [01:48<00:02, 22.84it/s] 98%|█████████▊| 2451/2500 [01:48<00:02, 22.86it/s] 98%|█████████▊| 2454/2500 [01:48<00:02, 22.89it/s] 98%|█████████▊| 2457/2500 [01:48<00:01, 22.90it/s] 98%|█████████▊| 2460/2500 [01:49<00:01, 22.92it/s] 99%|█████████▊| 2463/2500 [01:49<00:01, 22.92it/s] 99%|█████████▊| 2466/2500 [01:49<00:01, 22.92it/s] 99%|█████████▉| 2469/2500 [01:49<00:01, 22.94it/s] 99%|█████████▉| 2472/2500 [01:49<00:01, 22.94it/s] 99%|█████████▉| 2475/2500 [01:49<00:01, 22.95it/s] 99%|█████████▉| 2478/2500 [01:49<00:00, 22.81it/s] 99%|█████████▉| 2481/2500 [01:49<00:00, 22.85it/s] 99%|█████████▉| 2484/2500 [01:50<00:00, 22.88it/s] 99%|█████████▉| 2487/2500 [01:50<00:00, 22.87it/s] 100%|█████████▉| 2490/2500 [01:50<00:00, 22.88it/s] 100%|█████████▉| 2493/2500 [01:50<00:00, 22.89it/s] 100%|█████████▉| 2496/2500 [01:50<00:00, 22.90it/s] 100%|█████████▉| 2499/2500 [01:50<00:00, 22.92it/s] 100%|██████████| 2500/2500 [01:50<00:00, 22.57it/s]
INFO:TestAccuracy:Batch size is 4, Accuracy: 0.6171
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
2024-11-13 16:36:58.638697174 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:36:58.638713382 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
INFO:BackendDCU:Batch size is 4, QPS: 94, Avg Latency:42.2, Tail Latency:44.31
2024-11-13 16:37:05.494680269 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:37:05.494698007 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
INFO:BackendDCU:Batch size is 8, QPS: 179, Avg Latency:44.5, Tail Latency:46.36
2024-11-13 16:37:12.667772182 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:37:12.667788482 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
INFO:BackendDCU:Batch size is 16, QPS: 332, Avg Latency:48.17, Tail Latency:50.45
2024-11-13 16:37:20.325742282 [W:onnxruntime:, session_state.cc:1169 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-11-13 16:37:20.325759260 [W:onnxruntime:, session_state.cc:1171 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
INFO:BackendDCU:Batch size is 24, QPS: 454, Avg Latency:52.83, Tail Latency:54.87
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/videobert-onnx-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/videobert-onnx-fp32/VIDEOBERT-ONNX-FP32-TO-FP32.JSON.pdf ]
ByteMLPerf/byte_infer_perf/general_perf/log/widedeep-tf-fp16.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
/usr/local/lib/python3.10/site-packages/tensorflow/python/keras/engine/training_arrays_v1.py:37: UserWarning: A NumPy version >=1.23.5 and <2.3.0 is required for this version of SciPy (detected version 1.23.0)
from scipy.sparse import issparse # pylint: disable=g-import-not-at-top
INFO:PerfEngine:******************************************* Start to test model: widedeep-tf-fp16. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: open_criteo_kaggle
INFO:CriteoKaggle:Initial...
0%| | 0/2000000 [00:00<?, ?it/s] 1%| | 16213/2000000 [00:00<00:12, 162114.31it/s] 2%|▏ | 33330/2000000 [00:00<00:11, 167434.26it/s] 3%|▎ | 50409/2000000 [00:00<00:11, 168963.62it/s] 3%|▎ | 67553/2000000 [00:00<00:11, 169938.10it/s] 4%|▍ | 84676/2000000 [00:00<00:11, 170398.44it/s] 5%|▌ | 101777/2000000 [00:00<00:11, 170603.65it/s] 6%|▌ | 118939/2000000 [00:00<00:11, 170933.96it/s] 7%|▋ | 136138/2000000 [00:00<00:10, 171268.24it/s] 8%|▊ | 153288/2000000 [00:00<00:10, 171338.19it/s] 9%|▊ | 170470/2000000 [00:01<00:10, 171483.70it/s] 9%|▉ | 187642/2000000 [00:01<00:10, 171550.18it/s] 10%|█ | 204798/2000000 [00:01<00:10, 171328.31it/s] 11%|█ | 222094/2000000 [00:01<00:10, 171818.22it/s] 12%|█▏ | 239276/2000000 [00:01<00:10, 171545.73it/s] 13%|█▎ | 256521/2000000 [00:01<00:10, 171813.98it/s] 14%|█▎ | 273703/2000000 [00:01<00:10, 171452.90it/s] 15%|█▍ | 290849/2000000 [00:01<00:10, 170739.40it/s] 15%|█▌ | 308236/2000000 [00:01<00:09, 171673.35it/s] 16%|█▋ | 325405/2000000 [00:01<00:09, 170573.33it/s] 17%|█▋ | 342914/2000000 [00:02<00:09, 171917.53it/s] 18%|█▊ | 360175/2000000 [00:02<00:09, 172121.88it/s] 19%|█▉ | 377389/2000000 [00:02<00:09, 171574.40it/s] 20%|█▉ | 394666/2000000 [00:02<00:09, 171928.16it/s] 21%|██ | 411860/2000000 [00:02<00:09, 170518.94it/s] 21%|██▏ | 429424/2000000 [00:02<00:09, 172039.90it/s] 22%|██▏ | 446700/2000000 [00:02<00:09, 172251.96it/s] 23%|██▎ | 463968/2000000 [00:02<00:08, 172375.99it/s] 24%|██▍ | 481209/2000000 [00:02<00:08, 172381.17it/s] 25%|██▍ | 498476/2000000 [00:02<00:08, 172464.50it/s] 26%|██▌ | 515756/2000000 [00:03<00:08, 172561.86it/s] 27%|██▋ | 533025/2000000 [00:03<00:08, 172596.00it/s] 28%|██▊ | 550286/2000000 [00:03<00:08, 172525.15it/s] 28%|██▊ | 567572/2000000 [00:03<00:08, 172620.76it/s] 29%|██▉ | 584864/2000000 [00:03<00:08, 172708.92it/s] 30%|███ | 602136/2000000 [00:03<00:08, 172683.41it/s] 31%|███ | 619405/2000000 [00:03<00:07, 172632.11it/s] 32%|███▏ | 636711/2000000 [00:03<00:07, 172756.26it/s] 33%|███▎ | 654010/2000000 [00:03<00:07, 172824.18it/s] 34%|███▎ | 671293/2000000 [00:03<00:07, 172824.25it/s] 34%|███▍ | 688576/2000000 [00:04<00:07, 172644.16it/s] 35%|███▌ | 705841/2000000 [00:04<00:07, 172612.66it/s] 36%|███▌ | 723103/2000000 [00:04<00:07, 172555.34it/s] 37%|███▋ | 740359/2000000 [00:04<00:07, 172545.93it/s] 38%|███▊ | 757614/2000000 [00:04<00:07, 172537.58it/s] 39%|███▊ | 774868/2000000 [00:04<00:07, 172374.94it/s] 40%|███▉ | 792147/2000000 [00:04<00:07, 172496.55it/s] 40%|████ | 809419/2000000 [00:04<00:06, 172561.12it/s] 41%|████▏ | 826689/2000000 [00:04<00:06, 172600.22it/s] 42%|████▏ | 843953/2000000 [00:04<00:06, 172610.10it/s] 43%|████▎ | 861215/2000000 [00:05<00:06, 172376.83it/s] 44%|████▍ | 878484/2000000 [00:05<00:06, 172467.52it/s] 45%|████▍ | 895767/2000000 [00:05<00:06, 172573.63it/s] 46%|████▌ | 913037/2000000 [00:05<00:06, 172609.97it/s] 47%|████▋ | 930311/2000000 [00:05<00:06, 172647.41it/s] 47%|████▋ | 947578/2000000 [00:05<00:06, 172652.13it/s] 48%|████▊ | 964844/2000000 [00:05<00:06, 172482.85it/s] 49%|████▉ | 982118/2000000 [00:05<00:05, 172556.03it/s] 50%|████▉ | 999382/2000000 [00:05<00:05, 172579.28it/s] 51%|█████ | 1016647/2000000 [00:05<00:05, 172596.10it/s] 52%|█████▏ | 1033940/2000000 [00:06<00:05, 172693.69it/s] 53%|█████▎ | 1051224/2000000 [00:06<00:05, 172735.77it/s] 53%|█████▎ | 1068517/2000000 [00:06<00:05, 172791.36it/s] 54%|█████▍ | 1085797/2000000 [00:06<00:05, 172475.39it/s] 55%|█████▌ | 1103077/2000000 [00:06<00:05, 172570.96it/s] 56%|█████▌ | 1120362/2000000 [00:06<00:05, 172653.29it/s] 57%|█████▋ | 1137676/2000000 [00:06<00:04, 172795.05it/s] 58%|█████▊ | 1154981/2000000 [00:06<00:04, 172870.19it/s] 59%|█████▊ | 1172283/2000000 [00:06<00:04, 172911.08it/s] 59%|█████▉ | 1189575/2000000 [00:06<00:04, 172800.99it/s] 60%|██████ | 1206876/2000000 [00:07<00:04, 172861.11it/s] 61%|██████ | 1224163/2000000 [00:07<00:04, 172574.26it/s] 62%|██████▏ | 1241454/2000000 [00:07<00:04, 172672.04it/s] 63%|██████▎ | 1258722/2000000 [00:07<00:04, 172640.80it/s] 64%|██████▍ | 1276001/2000000 [00:07<00:04, 172683.23it/s] 65%|██████▍ | 1293287/2000000 [00:07<00:04, 172732.57it/s] 66%|██████▌ | 1310573/2000000 [00:07<00:03, 172766.63it/s] 66%|██████▋ | 1327850/2000000 [00:07<00:03, 172747.43it/s] 67%|██████▋ | 1345125/2000000 [00:07<00:03, 172730.59it/s] 68%|██████▊ | 1362427/2000000 [00:07<00:03, 172813.36it/s] 69%|██████▉ | 1379709/2000000 [00:08<00:03, 172464.16it/s] 70%|██████▉ | 1397023/2000000 [00:08<00:03, 172664.42it/s] 71%|███████ | 1414321/2000000 [00:08<00:03, 172756.69it/s] 72%|███████▏ | 1431624/2000000 [00:08<00:03, 172836.82it/s] 72%|███████▏ | 1448932/2000000 [00:08<00:03, 172906.81it/s] 73%|███████▎ | 1466239/2000000 [00:08<00:03, 172952.09it/s] 74%|███████▍ | 1483536/2000000 [00:08<00:02, 172953.06it/s] 75%|███████▌ | 1500832/2000000 [00:08<00:02, 172914.26it/s] 76%|███████▌ | 1518124/2000000 [00:08<00:02, 172844.72it/s] 77%|███████▋ | 1535422/2000000 [00:08<00:02, 172883.48it/s] 78%|███████▊ | 1552711/2000000 [00:09<00:02, 172478.28it/s] 79%|███████▊ | 1570029/2000000 [00:09<00:02, 172684.38it/s] 79%|███████▉ | 1587349/2000000 [00:09<00:02, 172836.31it/s] 80%|████████ | 1604657/2000000 [00:09<00:02, 172905.07it/s] 81%|████████ | 1621958/2000000 [00:09<00:02, 172933.49it/s] 82%|████████▏ | 1639252/2000000 [00:09<00:02, 172927.33it/s] 83%|████████▎ | 1656551/2000000 [00:09<00:01, 172943.95it/s] 84%|████████▎ | 1673848/2000000 [00:09<00:01, 172948.72it/s] 85%|████████▍ | 1691154/2000000 [00:09<00:01, 172979.30it/s] 85%|████████▌ | 1708452/2000000 [00:09<00:01, 172889.43it/s] 86%|████████▋ | 1725741/2000000 [00:10<00:01, 172797.98it/s] 87%|████████▋ | 1743021/2000000 [00:10<00:01, 172285.26it/s] 88%|████████▊ | 1760284/2000000 [00:10<00:01, 172383.42it/s] 89%|████████▉ | 1777537/2000000 [00:10<00:01, 172425.89it/s] 90%|████████▉ | 1794828/2000000 [00:10<00:01, 172569.63it/s] 91%|█████████ | 1812115/2000000 [00:10<00:01, 172658.23it/s] 91%|█████████▏| 1829405/2000000 [00:10<00:00, 172729.40it/s] 92%|█████████▏| 1846694/2000000 [00:10<00:00, 172776.25it/s] 93%|█████████▎| 1863992/2000000 [00:10<00:00, 172833.33it/s] 94%|█████████▍| 1881276/2000000 [00:10<00:00, 172753.23it/s] 95%|█████████▍| 1898552/2000000 [00:11<00:00, 172753.95it/s] 96%|█████████▌| 1915834/2000000 [00:11<00:00, 172771.46it/s] 97%|█████████▋| 1933134/2000000 [00:11<00:00, 172837.21it/s] 98%|█████████▊| 1950433/2000000 [00:11<00:00, 172878.89it/s] 98%|█████████▊| 1967721/2000000 [00:11<00:00, 172204.64it/s] 99%|█████████▉| 1985004/2000000 [00:11<00:00, 172388.94it/s] 100%|██████████| 2000000/2000000 [00:11<00:00, 172347.95it/s]
INFO:CriteoKaggle:Preprocessing...
INFO:CriteoKaggle:Rebatching batch size to: 1 ...
0%| | 0/2000000 [00:00<?, ?it/s] 3%|▎ | 61038/2000000 [00:00<00:03, 610358.75it/s] 6%|▌ | 124243/2000000 [00:00<00:03, 623101.87it/s] 9%|▉ | 187585/2000000 [00:00<00:02, 627802.58it/s] 13%|█▎ | 251426/2000000 [00:00<00:02, 631982.68it/s] 16%|█▌ | 314985/2000000 [00:00<00:02, 633277.16it/s] 19%|█▉ | 378404/2000000 [00:00<00:02, 633581.05it/s] 22%|██▏ | 442269/2000000 [00:00<00:02, 635232.92it/s] 25%|██▌ | 505997/2000000 [00:00<00:02, 635879.97it/s] 28%|██▊ | 569759/2000000 [00:00<00:02, 636416.99it/s] 32%|███▏ | 633401/2000000 [00:01<00:02, 636400.31it/s] 35%|███▍ | 697042/2000000 [00:01<00:02, 635711.86it/s] 38%|███▊ | 760614/2000000 [00:01<00:01, 635670.75it/s] 41%|████ | 824702/2000000 [00:01<00:01, 637243.47it/s] 44%|████▍ | 888427/2000000 [00:01<00:01, 636551.88it/s] 48%|████▊ | 952083/2000000 [00:01<00:01, 635434.12it/s] 51%|█████ | 1016273/2000000 [00:01<00:01, 637372.14it/s] 54%|█████▍ | 1080011/2000000 [00:01<00:01, 635477.50it/s] 57%|█████▋ | 1144235/2000000 [00:01<00:01, 637499.45it/s] 60%|██████ | 1207987/2000000 [00:01<00:01, 635662.17it/s] 64%|██████▎ | 1272042/2000000 [00:02<00:01, 637121.07it/s] 67%|██████▋ | 1336156/2000000 [00:02<00:01, 638318.24it/s] 70%|██████▉ | 1399990/2000000 [00:02<00:00, 635109.90it/s] 73%|███████▎ | 1464169/2000000 [00:02<00:00, 637099.25it/s] 76%|███████▋ | 1527883/2000000 [00:02<00:00, 636159.99it/s] 80%|███████▉ | 1591846/2000000 [00:02<00:00, 637192.80it/s] 83%|████████▎ | 1655654/2000000 [00:02<00:00, 637452.17it/s] 86%|████████▌ | 1719401/2000000 [00:02<00:00, 635973.06it/s] 89%|████████▉ | 1783734/2000000 [00:02<00:00, 638170.15it/s] 92%|█████████▏| 1847950/2000000 [00:02<00:00, 639360.41it/s] 96%|█████████▌| 1911888/2000000 [00:03<00:00, 634141.15it/s] 99%|█████████▉| 1975949/2000000 [00:03<00:00, 636061.79it/s] 100%|██████████| 2000000/2000000 [00:03<00:00, 635577.02it/s]
INFO:PerfEngine:Start to compile the model...
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:CriteoKaggle:Rebatching batch size to: 1024 ...
0%| | 0/1953 [00:00<?, ?it/s] 100%|██████████| 1953/1953 [00:00<00:00, 583521.56it/s]
INFO:TestAccuracy:Start to calculate accuracy...
0%| | 0/1953 [00:00<?, ?it/s]WARNING:absl:`new_categorical_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_categorical_placeholder_0`.
WARNING:absl:`new_numeric_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_numeric_placeholder_0`.
0%| | 1/1953 [00:04<2:17:51, 4.24s/it]WARNING:absl:`new_categorical_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_categorical_placeholder_0`.
WARNING:absl:`new_numeric_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_numeric_placeholder_0`.
WARNING:absl:`new_categorical_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_categorical_placeholder_0`.
1%|▏ | 27/1953 [00:04<03:41, 8.70it/s] 3%|▎ | 53/1953 [00:04<01:35, 19.86it/s] 4%|▍ | 79/1953 [00:04<00:54, 34.17it/s] 5%|▌ | 105/1953 [00:04<00:35, 51.84it/s] 7%|▋ | 131/1953 [00:04<00:25, 72.70it/s] 8%|▊ | 157/1953 [00:04<00:18, 96.10it/s] 9%|▉ | 183/1953 [00:04<00:14, 120.79it/s] 11%|█ | 209/1953 [00:05<00:12, 145.23it/s] 12%|█▏ | 235/1953 [00:05<00:10, 168.14it/s] 13%|█▎ | 261/1953 [00:05<00:08, 188.23it/s] 15%|█▍ | 287/1953 [00:05<00:08, 205.01it/s] 16%|█▌ | 313/1953 [00:05<00:07, 218.52it/s] 17%|█▋ | 339/1953 [00:05<00:07, 228.93it/s] 19%|█▊ | 365/1953 [00:05<00:06, 236.25it/s] 20%|██ | 391/1953 [00:05<00:06, 242.25it/s] 21%|██▏ | 417/1953 [00:05<00:06, 246.40it/s] 23%|██▎ | 443/1953 [00:05<00:06, 249.67it/s] 24%|██▍ | 469/1953 [00:06<00:05, 251.58it/s] 25%|██▌ | 495/1953 [00:06<00:05, 253.10it/s] 27%|██▋ | 521/1953 [00:06<00:05, 254.12it/s] 28%|██▊ | 547/1953 [00:06<00:05, 254.28it/s] 29%|██▉ | 573/1953 [00:06<00:05, 254.97it/s] 31%|███ | 599/1953 [00:06<00:05, 255.56it/s] 32%|███▏ | 625/1953 [00:06<00:05, 255.90it/s] 33%|███▎ | 651/1953 [00:06<00:05, 256.11it/s] 35%|███▍ | 677/1953 [00:06<00:04, 256.05it/s] 36%|███▌ | 703/1953 [00:06<00:04, 255.79it/s] 37%|███▋ | 729/1953 [00:07<00:04, 255.83it/s] 39%|███▊ | 755/1953 [00:07<00:04, 256.06it/s] 40%|███▉ | 781/1953 [00:07<00:04, 256.21it/s] 41%|████▏ | 807/1953 [00:07<00:04, 256.35it/s] 43%|████▎ | 833/1953 [00:07<00:04, 256.53it/s] 44%|████▍ | 859/1953 [00:07<00:04, 256.44it/s] 45%|████▌ | 885/1953 [00:07<00:04, 256.66it/s] 47%|████▋ | 911/1953 [00:07<00:04, 256.80it/s] 48%|████▊ | 937/1953 [00:07<00:03, 256.80it/s] 49%|████▉ | 963/1953 [00:07<00:03, 256.92it/s] 51%|█████ | 989/1953 [00:08<00:03, 256.90it/s] 52%|█████▏ | 1015/1953 [00:08<00:03, 256.62it/s] 53%|█████▎ | 1041/1953 [00:08<00:03, 256.07it/s] 55%|█████▍ | 1067/1953 [00:08<00:03, 256.42it/s] 56%|█████▌ | 1093/1953 [00:08<00:03, 256.54it/s] 57%|█████▋ | 1119/1953 [00:08<00:03, 256.99it/s] 59%|█████▊ | 1145/1953 [00:08<00:03, 257.16it/s] 60%|█████▉ | 1171/1953 [00:08<00:03, 257.38it/s] 61%|██████▏ | 1197/1953 [00:08<00:02, 257.32it/s] 63%|██████▎ | 1223/1953 [00:09<00:02, 257.24it/s] 64%|██████▍ | 1249/1953 [00:09<00:02, 257.32it/s] 65%|██████▌ | 1275/1953 [00:09<00:02, 257.37it/s] 67%|██████▋ | 1301/1953 [00:09<00:02, 257.24it/s] 68%|██████▊ | 1327/1953 [00:09<00:02, 257.30it/s] 69%|██████▉ | 1353/1953 [00:09<00:02, 257.24it/s] 71%|███████ | 1379/1953 [00:09<00:02, 257.29it/s] 72%|███████▏ | 1405/1953 [00:09<00:02, 257.07it/s] 73%|███████▎ | 1431/1953 [00:09<00:02, 257.16it/s] 75%|███████▍ | 1457/1953 [00:09<00:01, 257.22it/s] 76%|███████▌ | 1483/1953 [00:10<00:01, 257.08it/s] 77%|███████▋ | 1509/1953 [00:10<00:01, 257.09it/s] 79%|███████▊ | 1535/1953 [00:10<00:01, 257.29it/s] 80%|███████▉ | 1561/1953 [00:10<00:01, 257.32it/s] 81%|████████▏ | 1587/1953 [00:10<00:01, 257.24it/s] 83%|████████▎ | 1613/1953 [00:10<00:01, 257.18it/s] 84%|████████▍ | 1639/1953 [00:10<00:01, 256.96it/s] 85%|████████▌ | 1665/1953 [00:10<00:01, 257.10it/s] 87%|████████▋ | 1691/1953 [00:10<00:01, 257.00it/s] 88%|████████▊ | 1717/1953 [00:10<00:00, 256.90it/s] 89%|████████▉ | 1743/1953 [00:11<00:00, 257.03it/s] 91%|█████████ | 1769/1953 [00:11<00:00, 257.01it/s] 92%|█████████▏| 1795/1953 [00:11<00:00, 256.82it/s] 93%|█████████▎| 1821/1953 [00:11<00:00, 256.82it/s] 95%|█████████▍| 1847/1953 [00:11<00:00, 256.85it/s] 96%|█████████▌| 1873/1953 [00:11<00:00, 256.88it/s] 97%|█████████▋| 1899/1953 [00:11<00:00, 256.90it/s] 99%|█████████▊| 1925/1953 [00:11<00:00, 256.80it/s] 100%|█████████▉| 1951/1953 [00:11<00:00, 256.82it/s] 100%|██████████| 1953/1953 [00:11<00:00, 164.94it/s]
INFO:TestAccuracy:Batch size is 1024, Accuracy: 0.77395
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 1024, QPS: 1066666, Avg Latency:0.96, Tail Latency:1.04
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 20000, QPS: 3200000, Avg Latency:6.25, Tail Latency:7.07
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 40000, QPS: 3159557, Avg Latency:12.66, Tail Latency:12.8
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 80000, QPS: 3898635, Avg Latency:20.52, Tail Latency:22.77
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 120000, QPS: 3271537, Avg Latency:36.68, Tail Latency:38.92
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 140000, QPS: 3170289, Avg Latency:44.16, Tail Latency:46.42
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 160000, QPS: 3132341, Avg Latency:51.08, Tail Latency:53.33
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 180000, QPS: 3092783, Avg Latency:58.2, Tail Latency:60.19
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 200000, QPS: 3504468, Avg Latency:57.07, Tail Latency:59.95
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 220000, QPS: 3054707, Avg Latency:72.02, Tail Latency:74.48
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 240000, QPS: 3099173, Avg Latency:77.44, Tail Latency:80.01
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 260000, QPS: 3584723, Avg Latency:72.53, Tail Latency:76.46
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/widedeep-tf-fp16/result-fp16.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/widedeep-tf-fp16/WIDEDEEP-TF-FP16-TO-FP16.JSON.pdf ]
Exception ignored in: <function AtomicFunction.__del__ at 0x7f584d658b80>
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
Exception ignored in: <function AtomicFunction.__del__ at 0x7f584d658b80>
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
Exception ignored in: <function AtomicFunction.__del__ at 0x7f584d658b80>
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
ByteMLPerf/byte_infer_perf/general_perf/log/widedeep-tf-fp32.log 0 → 100644
View file @ 24b257f1
INFO:LANUCH:******************* Pip Package Installing *******************
INFO:PerfEngine:******************* Backend Env Initization *******************
INFO:BackendStore:Loading Compile Backend: DCU
INFO:BackendStore:Loading Runtime Backend: DCU
INFO:PerfEngine:******************************************* Start to test model: widedeep-tf-fp32. *******************************************
INFO:PerfEngine:******************************************* Running Backend Compilation... *******************************************
INFO:PerfEngine:Running Backend Preoptimization...
INFO:DatasetStore:Loading Dataset: open_criteo_kaggle
INFO:CriteoKaggle:Initial...
0%| | 0/2000000 [00:00<?, ?it/s] 1%| | 15977/2000000 [00:00<00:12, 159759.11it/s] 2%|▏ | 32807/2000000 [00:00<00:11, 164776.18it/s] 2%|▏ | 49613/2000000 [00:00<00:11, 166269.68it/s] 3%|▎ | 66523/2000000 [00:00<00:11, 167384.24it/s] 4%|▍ | 83446/2000000 [00:00<00:11, 168044.95it/s] 5%|▌ | 100290/2000000 [00:00<00:11, 168174.55it/s] 6%|▌ | 117292/2000000 [00:00<00:11, 168772.10it/s] 7%|▋ | 134264/2000000 [00:00<00:11, 169071.34it/s] 8%|▊ | 151172/2000000 [00:00<00:10, 169004.06it/s] 8%|▊ | 168073/2000000 [00:01<00:10, 168836.86it/s] 9%|▉ | 184960/2000000 [00:01<00:10, 168844.46it/s] 10%|█ | 201857/2000000 [00:01<00:10, 168878.39it/s] 11%|█ | 218745/2000000 [00:01<00:10, 168793.51it/s] 12%|█▏ | 235625/2000000 [00:01<00:10, 168584.29it/s] 13%|█▎ | 252500/2000000 [00:01<00:10, 168632.41it/s] 13%|█▎ | 269364/2000000 [00:01<00:10, 168400.03it/s] 14%|█▍ | 286292/2000000 [00:01<00:10, 168660.87it/s] 15%|█▌ | 303159/2000000 [00:01<00:10, 168309.20it/s] 16%|█▌ | 320092/2000000 [00:01<00:09, 168612.61it/s] 17%|█▋ | 336954/2000000 [00:02<00:09, 168139.98it/s] 18%|█▊ | 353859/2000000 [00:02<00:09, 168408.98it/s] 19%|█▊ | 370701/2000000 [00:02<00:09, 167604.23it/s] 19%|█▉ | 387675/2000000 [00:02<00:09, 168239.77it/s] 20%|██ | 404599/2000000 [00:02<00:09, 168536.39it/s] 21%|██ | 421454/2000000 [00:02<00:09, 168154.12it/s] 22%|██▏ | 438271/2000000 [00:02<00:09, 167648.53it/s] 23%|██▎ | 455191/2000000 [00:02<00:09, 168109.95it/s] 24%|██▎ | 472060/2000000 [00:02<00:09, 168279.16it/s] 24%|██▍ | 488923/2000000 [00:02<00:08, 168382.67it/s] 25%|██▌ | 505819/2000000 [00:03<00:08, 168552.64it/s] 26%|██▌ | 522723/2000000 [00:03<00:08, 168695.73it/s] 27%|██▋ | 539646/2000000 [00:03<00:08, 168852.43it/s] 28%|██▊ | 556602/2000000 [00:03<00:08, 169061.25it/s] 29%|██▊ | 573592/2000000 [00:03<00:08, 169310.16it/s] 30%|██▉ | 590547/2000000 [00:03<00:08, 169377.78it/s] 30%|███ | 607485/2000000 [00:03<00:08, 169340.35it/s] 31%|███ | 624449/2000000 [00:03<00:08, 169428.45it/s] 32%|███▏ | 641422/2000000 [00:03<00:08, 169512.64it/s] 33%|███▎ | 658416/2000000 [00:03<00:07, 169636.63it/s] 34%|███▍ | 675380/2000000 [00:04<00:07, 169591.60it/s] 35%|███▍ | 692340/2000000 [00:04<00:07, 169503.14it/s] 35%|███▌ | 709329/2000000 [00:04<00:07, 169616.27it/s] 36%|███▋ | 726347/2000000 [00:04<00:07, 169782.70it/s] 37%|███▋ | 743367/2000000 [00:04<00:07, 169903.77it/s] 38%|███▊ | 760516/2000000 [00:04<00:07, 170375.56it/s] 39%|███▉ | 777577/2000000 [00:04<00:07, 170444.10it/s] 40%|███▉ | 794674/2000000 [00:04<00:07, 170600.19it/s] 41%|████ | 811870/2000000 [00:04<00:06, 171005.08it/s] 41%|████▏ | 829096/2000000 [00:04<00:06, 171377.41it/s] 42%|████▏ | 846269/2000000 [00:05<00:06, 171479.55it/s] 43%|████▎ | 863417/2000000 [00:05<00:06, 171358.28it/s] 44%|████▍ | 880569/2000000 [00:05<00:06, 171404.98it/s] 45%|████▍ | 897710/2000000 [00:05<00:06, 171402.86it/s] 46%|████▌ | 914866/2000000 [00:05<00:06, 171446.11it/s] 47%|████▋ | 932047/2000000 [00:05<00:06, 171553.46it/s] 47%|████▋ | 949291/2000000 [00:05<00:06, 171817.22it/s] 48%|████▊ | 966473/2000000 [00:05<00:06, 171791.32it/s] 49%|████▉ | 983676/2000000 [00:05<00:05, 171859.64it/s] 50%|█████ | 1000862/2000000 [00:05<00:05, 171486.73it/s] 51%|█████ | 1018011/2000000 [00:06<00:05, 171083.01it/s] 52%|█████▏ | 1035120/2000000 [00:06<00:05, 170741.11it/s] 53%|█████▎ | 1052195/2000000 [00:06<00:05, 170478.41it/s] 53%|█████▎ | 1069244/2000000 [00:06<00:05, 170460.78it/s] 54%|█████▍ | 1086342/2000000 [00:06<00:05, 170613.77it/s] 55%|█████▌ | 1103584/2000000 [00:06<00:05, 171150.70it/s] 56%|█████▌ | 1120786/2000000 [00:06<00:05, 171408.89it/s] 57%|█████▋ | 1138059/2000000 [00:06<00:05, 171803.32it/s] 58%|█████▊ | 1155314/2000000 [00:06<00:04, 172023.55it/s] 59%|█████▊ | 1172604/2000000 [00:06<00:04, 172284.57it/s] 59%|█████▉ | 1189875/2000000 [00:07<00:04, 172410.35it/s] 60%|██████ | 1207120/2000000 [00:07<00:04, 172420.20it/s] 61%|██████ | 1224363/2000000 [00:07<00:04, 172182.22it/s] 62%|██████▏ | 1241582/2000000 [00:07<00:04, 172129.26it/s] 63%|██████▎ | 1258795/2000000 [00:07<00:04, 172105.55it/s] 64%|██████▍ | 1276027/2000000 [00:07<00:04, 172167.67it/s] 65%|██████▍ | 1293244/2000000 [00:07<00:04, 172088.09it/s] 66%|██████▌ | 1310456/2000000 [00:07<00:04, 172095.86it/s] 66%|██████▋ | 1327666/2000000 [00:07<00:03, 172049.55it/s] 67%|██████▋ | 1344885/2000000 [00:07<00:03, 172088.51it/s] 68%|██████▊ | 1362099/2000000 [00:08<00:03, 172102.03it/s] 69%|██████▉ | 1379310/2000000 [00:08<00:03, 171705.32it/s] 70%|██████▉ | 1396544/2000000 [00:08<00:03, 171893.58it/s] 71%|███████ | 1413734/2000000 [00:08<00:03, 171875.67it/s] 72%|███████▏ | 1430973/2000000 [00:08<00:03, 172026.42it/s] 72%|███████▏ | 1448198/2000000 [00:08<00:03, 172091.53it/s] 73%|███████▎ | 1465408/2000000 [00:08<00:03, 172029.31it/s] 74%|███████▍ | 1482623/2000000 [00:08<00:03, 172063.82it/s] 75%|███████▍ | 1499830/2000000 [00:08<00:02, 171969.58it/s] 76%|███████▌ | 1517056/2000000 [00:08<00:02, 172051.77it/s] 77%|███████▋ | 1534262/2000000 [00:09<00:02, 171984.82it/s] 78%|███████▊ | 1551461/2000000 [00:09<00:02, 171648.40it/s] 78%|███████▊ | 1568658/2000000 [00:09<00:02, 171742.91it/s] 79%|███████▉ | 1585833/2000000 [00:09<00:02, 171738.22it/s] 80%|████████ | 1603038/2000000 [00:09<00:02, 171828.64it/s] 81%|████████ | 1620221/2000000 [00:09<00:02, 171824.06it/s] 82%|████████▏ | 1637422/2000000 [00:09<00:02, 171875.81it/s] 83%|████████▎ | 1654635/2000000 [00:09<00:02, 171948.65it/s] 84%|████████▎ | 1671830/2000000 [00:09<00:01, 171913.33it/s] 84%|████████▍ | 1689067/2000000 [00:09<00:01, 172046.52it/s] 85%|████████▌ | 1706272/2000000 [00:10<00:01, 171902.81it/s] 86%|████████▌ | 1723475/2000000 [00:10<00:01, 171938.77it/s] 87%|████████▋ | 1740669/2000000 [00:10<00:01, 171571.61it/s] 88%|████████▊ | 1757851/2000000 [00:10<00:01, 171643.83it/s] 89%|████████▉ | 1775100/2000000 [00:10<00:01, 171893.10it/s] 90%|████████▉ | 1792307/2000000 [00:10<00:01, 171942.85it/s] 90%|█████████ | 1809529/2000000 [00:10<00:01, 172024.39it/s] 91%|█████████▏| 1826766/2000000 [00:10<00:01, 172126.23it/s] 92%|█████████▏| 1843979/2000000 [00:10<00:00, 172064.05it/s] 93%|█████████▎| 1861226/2000000 [00:10<00:00, 172183.85it/s] 94%|█████████▍| 1878445/2000000 [00:11<00:00, 172154.48it/s] 95%|█████████▍| 1895667/2000000 [00:11<00:00, 172170.24it/s] 96%|█████████▌| 1912886/2000000 [00:11<00:00, 172172.77it/s] 97%|█████████▋| 1930106/2000000 [00:11<00:00, 172177.54it/s] 97%|█████████▋| 1947362/2000000 [00:11<00:00, 172287.63it/s] 98%|█████████▊| 1964591/2000000 [00:11<00:00, 171562.40it/s] 99%|█████████▉| 1981806/2000000 [00:11<00:00, 171733.78it/s] 100%|█████████▉| 1999034/2000000 [00:11<00:00, 171892.44it/s] 100%|██████████| 2000000/2000000 [00:11<00:00, 170624.28it/s]
INFO:CriteoKaggle:Preprocessing...
INFO:CriteoKaggle:Rebatching batch size to: 1 ...
0%| | 0/2000000 [00:00<?, ?it/s] 3%|▎ | 61843/2000000 [00:00<00:03, 618408.47it/s] 6%|▋ | 125116/2000000 [00:00<00:02, 626814.67it/s] 9%|▉ | 188320/2000000 [00:00<00:02, 629190.61it/s] 13%|█▎ | 252054/2000000 [00:00<00:02, 632397.34it/s] 16%|█▌ | 315634/2000000 [00:00<00:02, 633615.29it/s] 19%|█▉ | 379097/2000000 [00:00<00:02, 633954.32it/s] 22%|██▏ | 442852/2000000 [00:00<00:02, 635122.08it/s] 25%|██▌ | 506526/2000000 [00:00<00:02, 635630.58it/s] 29%|██▊ | 570168/2000000 [00:00<00:02, 635873.28it/s] 32%|███▏ | 633756/2000000 [00:01<00:02, 635842.78it/s] 35%|███▍ | 697341/2000000 [00:01<00:02, 635324.60it/s] 38%|███▊ | 760874/2000000 [00:01<00:01, 635153.77it/s] 41%|████▏ | 825028/2000000 [00:01<00:01, 637081.41it/s] 44%|████▍ | 888737/2000000 [00:01<00:01, 636418.55it/s] 48%|████▊ | 952380/2000000 [00:01<00:01, 635150.42it/s] 51%|█████ | 1016598/2000000 [00:01<00:01, 637256.55it/s] 54%|█████▍ | 1080325/2000000 [00:01<00:01, 635520.62it/s] 57%|█████▋ | 1143879/2000000 [00:01<00:01, 633349.63it/s] 60%|██████ | 1207581/2000000 [00:01<00:01, 634440.92it/s] 64%|██████▎ | 1271589/2000000 [00:02<00:01, 636123.43it/s] 67%|██████▋ | 1335740/2000000 [00:02<00:01, 637728.73it/s] 70%|██████▉ | 1399515/2000000 [00:02<00:00, 637275.90it/s] 73%|███████▎ | 1463637/2000000 [00:02<00:00, 638451.83it/s] 76%|███████▋ | 1527484/2000000 [00:02<00:00, 635238.59it/s] 80%|███████▉ | 1591675/2000000 [00:02<00:00, 637224.11it/s] 83%|████████▎ | 1655495/2000000 [00:02<00:00, 637510.29it/s] 86%|████████▌ | 1719249/2000000 [00:02<00:00, 632980.06it/s] 89%|████████▉ | 1783454/2000000 [00:02<00:00, 635679.64it/s] 92%|█████████▏| 1847742/2000000 [00:02<00:00, 637825.62it/s] 96%|█████████▌| 1911531/2000000 [00:03<00:00, 633417.84it/s] 99%|█████████▉| 1975652/2000000 [00:03<00:00, 635735.04it/s] 100%|██████████| 2000000/2000000 [00:03<00:00, 635265.12it/s]
INFO:PerfEngine:Start to compile the model...
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:CriteoKaggle:Rebatching batch size to: 1024 ...
0%| | 0/1953 [00:00<?, ?it/s] 100%|██████████| 1953/1953 [00:00<00:00, 602358.68it/s]
INFO:TestAccuracy:Start to calculate accuracy...
0%| | 0/1953 [00:00<?, ?it/s]WARNING:absl:`new_categorical_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_categorical_placeholder_0`.
WARNING:absl:`new_numeric_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_numeric_placeholder_0`.
0%| | 1/1953 [00:03<2:06:35, 3.89s/it]WARNING:absl:`new_categorical_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_categorical_placeholder_0`.
WARNING:absl:`new_numeric_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_numeric_placeholder_0`.
WARNING:absl:`new_categorical_placeholder:0` is not a valid tf.function parameter name. Sanitizing to `new_categorical_placeholder_0`.
1%|▏ | 26/1953 [00:03<03:31, 9.10it/s] 3%|▎ | 52/1953 [00:04<01:29, 21.13it/s] 4%|▍ | 78/1953 [00:04<00:51, 36.39it/s] 5%|▌ | 104/1953 [00:04<00:33, 54.99it/s] 7%|▋ | 130/1953 [00:04<00:23, 76.61it/s] 8%|▊ | 156/1953 [00:04<00:17, 100.36it/s] 9%|▉ | 182/1953 [00:04<00:14, 124.93it/s] 11%|█ | 207/1953 [00:04<00:11, 147.84it/s] 12%|█▏ | 233/1953 [00:04<00:10, 169.98it/s] 13%|█▎ | 259/1953 [00:04<00:08, 188.93it/s] 15%|█▍ | 285/1953 [00:05<00:08, 204.53it/s] 16%|█▌ | 311/1953 [00:05<00:07, 216.97it/s] 17%|█▋ | 337/1953 [00:05<00:07, 226.36it/s] 19%|█▊ | 363/1953 [00:05<00:06, 233.37it/s] 20%|█▉ | 389/1953 [00:05<00:06, 238.50it/s] 21%|██ | 415/1953 [00:05<00:06, 242.38it/s] 23%|██▎ | 441/1953 [00:05<00:06, 245.00it/s] 24%|██▍ | 467/1953 [00:05<00:06, 247.06it/s] 25%|██▌ | 493/1953 [00:05<00:05, 248.31it/s] 27%|██▋ | 519/1953 [00:05<00:05, 249.46it/s] 28%|██▊ | 545/1953 [00:06<00:05, 250.19it/s] 29%|██▉ | 571/1953 [00:06<00:05, 250.75it/s] 31%|███ | 597/1953 [00:06<00:05, 251.05it/s] 32%|███▏ | 623/1953 [00:06<00:05, 251.13it/s] 33%|███▎ | 649/1953 [00:06<00:05, 251.30it/s] 35%|███▍ | 675/1953 [00:06<00:05, 249.35it/s] 36%|███▌ | 700/1953 [00:06<00:05, 248.66it/s] 37%|███▋ | 725/1953 [00:06<00:04, 248.13it/s] 38%|███▊ | 750/1953 [00:06<00:04, 247.67it/s] 40%|███▉ | 775/1953 [00:06<00:04, 247.52it/s] 41%|████ | 800/1953 [00:07<00:04, 247.44it/s] 42%|████▏ | 825/1953 [00:07<00:04, 247.39it/s] 44%|████▎ | 850/1953 [00:07<00:04, 247.23it/s] 45%|████▍ | 875/1953 [00:07<00:04, 247.13it/s] 46%|████▌ | 900/1953 [00:07<00:04, 247.03it/s] 47%|████▋ | 925/1953 [00:07<00:04, 247.06it/s] 49%|████▊ | 950/1953 [00:07<00:04, 246.99it/s] 50%|████▉ | 975/1953 [00:07<00:03, 247.03it/s] 51%|█████ | 1000/1953 [00:07<00:03, 246.44it/s] 52%|█████▏ | 1025/1953 [00:07<00:03, 246.36it/s] 54%|█████▍ | 1050/1953 [00:08<00:03, 246.61it/s] 55%|█████▌ | 1075/1953 [00:08<00:03, 246.89it/s] 56%|█████▋ | 1100/1953 [00:08<00:03, 247.02it/s] 58%|█████▊ | 1125/1953 [00:08<00:03, 246.94it/s] 59%|█████▉ | 1150/1953 [00:08<00:03, 247.01it/s] 60%|██████ | 1175/1953 [00:08<00:03, 247.04it/s] 61%|██████▏ | 1200/1953 [00:08<00:03, 247.10it/s] 63%|██████▎ | 1225/1953 [00:08<00:02, 247.14it/s] 64%|██████▍ | 1250/1953 [00:08<00:02, 244.76it/s] 65%|██████▌ | 1276/1953 [00:09<00:02, 246.58it/s] 67%|██████▋ | 1301/1953 [00:09<00:02, 247.58it/s] 68%|██████▊ | 1327/1953 [00:09<00:02, 248.48it/s] 69%|██████▉ | 1352/1953 [00:09<00:02, 247.68it/s] 71%|███████ | 1377/1953 [00:09<00:02, 248.31it/s] 72%|███████▏ | 1402/1953 [00:09<00:02, 248.77it/s] 73%|███████▎ | 1427/1953 [00:09<00:02, 249.01it/s] 74%|███████▍ | 1453/1953 [00:09<00:02, 249.39it/s] 76%|███████▌ | 1479/1953 [00:09<00:01, 249.57it/s] 77%|███████▋ | 1504/1953 [00:09<00:01, 249.64it/s] 78%|███████▊ | 1530/1953 [00:10<00:01, 249.98it/s] 80%|███████▉ | 1555/1953 [00:10<00:01, 249.94it/s] 81%|████████ | 1581/1953 [00:10<00:01, 250.12it/s] 82%|████████▏ | 1607/1953 [00:10<00:01, 250.42it/s] 84%|████████▎ | 1633/1953 [00:10<00:01, 250.71it/s] 85%|████████▍ | 1659/1953 [00:10<00:01, 250.86it/s] 86%|████████▋ | 1685/1953 [00:10<00:01, 250.90it/s] 88%|████████▊ | 1711/1953 [00:10<00:00, 251.08it/s] 89%|████████▉ | 1737/1953 [00:10<00:00, 251.14it/s] 90%|█████████ | 1763/1953 [00:10<00:00, 251.19it/s] 92%|█████████▏| 1789/1953 [00:11<00:00, 251.07it/s] 93%|█████████▎| 1815/1953 [00:11<00:00, 251.10it/s] 94%|█████████▍| 1841/1953 [00:11<00:00, 251.01it/s] 96%|█████████▌| 1867/1953 [00:11<00:00, 250.98it/s] 97%|█████████▋| 1893/1953 [00:11<00:00, 250.87it/s] 98%|█████████▊| 1919/1953 [00:11<00:00, 250.75it/s] 100%|█████████▉| 1945/1953 [00:11<00:00, 250.76it/s] 100%|██████████| 1953/1953 [00:11<00:00, 166.71it/s]
INFO:TestAccuracy:Batch size is 1024, Accuracy: 0.77394
INFO:PerfEngine:******************************************* Runing QPS Checker... *******************************************
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 1024, QPS: 994174, Avg Latency:1.03, Tail Latency:1.39
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 20000, QPS: 2869440, Avg Latency:6.97, Tail Latency:7.05
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 40000, QPS: 2941176, Avg Latency:13.6, Tail Latency:16.03
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 80000, QPS: 2881844, Avg Latency:27.76, Tail Latency:30.16
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 120000, QPS: 3425635, Avg Latency:35.03, Tail Latency:37.36
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 140000, QPS: 3406326, Avg Latency:41.1, Tail Latency:43.22
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 160000, QPS: 3436426, Avg Latency:46.56, Tail Latency:48.9
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 180000, QPS: 2748511, Avg Latency:65.49, Tail Latency:67.9
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 200000, QPS: 3251503, Avg Latency:61.51, Tail Latency:63.47
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 220000, QPS: 2696078, Avg Latency:81.6, Tail Latency:83.84
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 240000, QPS: 2652226, Avg Latency:90.49, Tail Latency:92.63
INFO:tensorflow:Saver not created because there are no variables in the graph to restore
INFO:absl:Fingerprint not found. Saved model loading will continue.
INFO:BackendDCU:Batch size is 260000, QPS: 2758913, Avg Latency:94.24, Tail Latency:96.49
INFO:PerfEngine:Testing Finish. Report is saved in path: [ general_perf/reports/DCU/widedeep-tf-fp32/result-fp32.json ]
INFO:PerfEngine:PDF Version is saved in path: [ general_perf/reports/DCU/widedeep-tf-fp32/WIDEDEEP-TF-FP32-TO-FP32.JSON.pdf ]
Exception ignored in: <function AtomicFunction.__del__ at 0x7f7ce8b5ca60>
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
Exception ignored in: <function AtomicFunction.__del__ at 0x7f7ce8b5ca60>
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
Exception ignored in: <function AtomicFunction.__del__ at 0x7f7ce8b5ca60>
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/tensorflow/python/eager/polymorphic_function/atomic_function.py", line 218, in __del__
TypeError: 'NoneType' object is not subscriptable
ByteMLPerf/byte_infer_perf/general_perf/log/yolov5-onnx-fp32.log 0 → 100644
View file @ 24b257f1
This source diff could not be displayed because it is too large. You can view the blob instead.
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/albert-torch-fp32.json 0 → 100644
View file @ 24b257f1
{
"model": "albert-torch-fp32",
"model_path": "general_perf/model_zoo/popular/open_albert/albert-base-squad.pt",
"framework": "Pytorch",
"framework_version": "1.9.1",
"model_format": "pt",
"model_precision": "FP32",
"inputs":"input_ids.1,attention_mask.1,token_type_ids.1",
"outputs":"start_logits,end_logits",
"input_shape": {"input_ids.1": [1,384], "attention_mask.1": [1,384], "token_type_ids.1": [1,384]},
"input_type": "LONG,LONG,LONG",
"dataset_name": "open_squad",
"max_batch_size": 64,
"is_quantized": false
}
\ No newline at end of file
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/bert-onnxruntime-fp16.json 0 → 100644
View file @ 24b257f1
{
"model": "bert-onnxruntime-fp16",
"model_path": "general_perf/model_zoo/regular/open_bert/bert-onnx-fp16.onnx",
"framework": "onnxruntime",
"framework_version": "2.13.1",
"model_format": "saved_model",
"model_precision": "FP16",
"inputs":"input_ids.1,attention_mask.1,token_type_ids.1",
"outputs":"start_logits,end_logits",
"input_shape": {"input_ids.1": [1,384], "attention_mask.1": [1,384], "token_type_ids.1": [1,384]},
"input_type": "LONG,LONG,LONG",
"dataset_name": "open_squad",
"max_batch_size": 1024,
"is_quantized": false
}
\ No newline at end of file
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/bert-onnxruntime-fp32.json 0 → 100644
View file @ 24b257f1
{
"model": "bert-onnxruntime-fp32",
"model_path": "general_perf/model_zoo/regular/open_bert/bert-onnx-fp32.onnx",
"framework": "onnxruntime",
"framework_version": "2.13.1",
"model_format": "saved_model",
"model_precision": "FP32",
"inputs":"input_ids.1,attention_mask.1,token_type_ids.1",
"outputs":"start_logits,end_logits",
"input_shape": {"input_ids.1": [1,384], "attention_mask.1": [1,384], "token_type_ids.1": [1,384]},
"input_type": "LONG,LONG,LONG",
"dataset_name": "open_squad",
"max_batch_size": 1024,
"is_quantized": false
}
\ No newline at end of file
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/bert-tf-fp16.json 0 → 100644
View file @ 24b257f1
{
"model": "bert-tf-fp16",
"model_path": "general_perf/model_zoo/regular/open_bert/bert_fp32",
"framework": "Tensorflow",
"framework_version": "2.13.1",
"model_format": "saved_model",
"model_precision": "FP16",
"inputs":"input_ids:0,input_mask:0,segment_ids:0",
"outputs":"logits:0",
"input_shape": {"input_ids:0": [1,384], "input_mask:0": [1,384], "segment_ids:0": [1,384]},
"input_type": "INT32,INT32,INT32",
"dataset_name": "open_squad",
"max_batch_size": 1024,
"is_quantized": false
}
\ No newline at end of file
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/bert-tf-fp32.json 0 → 100644
View file @ 24b257f1
{
"model": "bert-tf-fp32",
"model_path": "general_perf/model_zoo/regular/open_bert/bert_fp32",
"framework": "Tensorflow",
"framework_version": "2.13.1",
"model_format": "saved_model",
"model_precision": "FP32",
"inputs":"input_ids:0,input_mask:0,segment_ids:0",
"outputs":"logits:0",
"input_shape": {"input_ids:0": [1,384], "input_mask:0": [1,384], "segment_ids:0": [1,384]},
"input_type": "INT32,INT32,INT32",
"dataset_name": "open_squad",
"max_batch_size": 1024,
"is_quantized": false
}
\ No newline at end of file
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/bert-torch-fp16.json 0 → 100644
View file @ 24b257f1
{
"model": "bert-torch-fp16",
"model_path": "general_perf/model_zoo/regular/open_bert/bert-base-uncased-squad-v1.pt",
"framework": "Pytorch",
"framework_version": "2.1.2+cu118",
"model_format": "pt",
"model_precision": "FP16",
"inputs":"input_ids.1,attention_mask.1,token_type_ids.1",
"outputs":"start_logits,end_logits",
"input_shape": {"input_ids.1": [1,384], "attention_mask.1": [1,384], "token_type_ids.1": [1,384]},
"input_type": "LONG,LONG,LONG",
"dataset_name": "open_squad",
"max_batch_size": 1024,
"is_quantized": false
}
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/bert-torch-fp32.json 0 → 100644
View file @ 24b257f1
{
"model": "bert-torch-fp32",
"model_path": "general_perf/model_zoo/regular/open_bert/bert-base-uncased-squad-v1.pt",
"framework": "Pytorch",
"framework_version": "2.1.2+cu118",
"model_format": "pt",
"model_precision": "FP32",
"inputs":"input_ids.1,attention_mask.1,token_type_ids.1",
"outputs":"start_logits,end_logits",
"input_shape": {"input_ids.1": [1,384], "attention_mask.1": [1,384], "token_type_ids.1": [1,384]},
"input_type": "LONG,LONG,LONG",
"dataset_name": "open_squad",
"max_batch_size": 1024,
"is_quantized": false
}
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/clip-onnx-fp32.json 0 → 100644
View file @ 24b257f1
{
"model": "clip-onnx-fp32",
"model_path": "general_perf/model_zoo/sota/stable_diffusion/clip-text-encoder.onnx",
"framework": "Onnx",
"framework_version": "1.12.0",
"model_format": "onnx",
"model_precision": "FP32",
"inputs":"input_ids",
"outputs":"last_hidden_state,pooler_output",
"input_shape": {"input_ids": [1,77]},
"input_type": "INT32",
"dataset_name": null,
"max_batch_size": 64,
"is_quantized": false
}
\ No newline at end of file
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/conformer-encoder-onnx-fp32.json 0 → 100644
View file @ 24b257f1
{
"model": "conformer-encoder-onnx-fp32",
"model_path": "general_perf/model_zoo/popular/open_conformer/conformer_encoder.onnx",
"framework": "Onnx",
"framework_version": "1.6",
"model_format": "onnx",
"model_precision": "FP32",
"inputs":"src,src_pad_mask",
"outputs":"memory",
"input_shape": {"src": [1, 3, 64, 512], "src_pad_mask": [1, 128]},
"input_type": "FLOAT32,BOOL",
"dataset_name": null,
"max_batch_size": 64,
"is_quantized": false
}
\ No newline at end of file
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/deberta-torch-fp32.json 0 → 100644
View file @ 24b257f1
{
"model": "deberta-torch-fp32",
"model_path": "general_perf/model_zoo/popular/open_deberta/deberta-base-squad.pt",
"framework": "Pytorch",
"framework_version": "1.10.0",
"model_format": "pt",
"model_precision": "FP32",
"inputs":"input_ids.1,attention_mask.1,token_type_ids.1",
"outputs":"start_logits,end_logits",
"input_shape": {"input_ids.1": [1,384], "attention_mask.1": [1,384], "token_type_ids.1": [1,384]},
"input_type": "LONG,LONG,LONG",
"dataset_name": "open_squad",
"max_batch_size": 64,
"is_quantized": false
}
ByteMLPerf/byte_infer_perf/general_perf/model_zoo/resnet50-onnxruntime-fp16.json 0 → 100644
View file @ 24b257f1
{
"model": "resnet50-onnxruntime-fp16",
"model_path": "general_perf/model_zoo/regular/open_resnet50/resnet50-torch-fp16.onnx",
"framework": "Onnx",
"framework_version": "2.13.1",
"model_format": "pt",
"model_precision": "FP16",
"inputs": "input_1.1",
"outputs": "softmax_tensor:0",
"input_shape": {"input_1.1": [1, 3, 224, 224]},
"input_type": "FLOAT16",
"dataset_name": "open_imagenet",
"max_batch_size": 1024,
"layout": "NCHW"
}
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment