2024-12-13 11:37:06,725 - INFO - *******batch_size: 1  *******QPS: 32.524046780674546
2024-12-13 11:37:12,373 - INFO - *******batch_size: 2  *******QPS: 64.97622474753246
2024-12-13 11:37:18,081 - INFO - *******batch_size: 4  *******QPS: 129.3292778767608
2024-12-13 11:37:24,032 - INFO - *******batch_size: 8  *******QPS: 263.6599831075599
2024-12-13 11:37:30,344 - INFO - *******batch_size: 16  *******QPS: 516.6422198608145
2024-12-13 11:37:37,570 - INFO - *******batch_size: 32  *******QPS: 1007.7148174351279
2024-12-13 11:37:46,628 - INFO - *******batch_size: 64  *******QPS: 1935.5863399399686
2024-12-13 11:37:59,230 - INFO - *******batch_size: 128  *******QPS: 3491.3746343255125
2024-12-13 11:38:18,635 - INFO - *******batch_size: 256  *******QPS: 6717.253936903814
2024-12-13 11:38:51,869 - INFO - *******batch_size: 512  *******QPS: 11045.15844458297
2024-12-13 11:39:54,011 - INFO - *******batch_size: 1024  *******QPS: 15985.287379320396
2024-12-13 11:41:53,970 - INFO - *******batch_size: 2048  *******QPS: 21212.32703888748