2024-12-13 11:56:16,487 - INFO - *******batch_size: 1  *******QPS: 28.448957120137806
2024-12-13 11:56:22,631 - INFO - *******batch_size: 2  *******QPS: 57.570425495453755
2024-12-13 11:56:28,761 - INFO - *******batch_size: 4  *******QPS: 116.83688591262103
2024-12-13 11:56:35,177 - INFO - *******batch_size: 8  *******QPS: 233.79212083177754
2024-12-13 11:56:41,912 - INFO - *******batch_size: 16  *******QPS: 463.97575531809497
2024-12-13 11:56:49,645 - INFO - *******batch_size: 32  *******QPS: 896.9596216319421
2024-12-13 11:56:59,165 - INFO - *******batch_size: 64  *******QPS: 1742.9214595545645
2024-12-13 11:57:12,276 - INFO - *******batch_size: 128  *******QPS: 3206.6887183008753
2024-12-13 11:57:32,150 - INFO - *******batch_size: 256  *******QPS: 6083.028168359787
2024-12-13 11:58:05,851 - INFO - *******batch_size: 512  *******QPS: 10230.784667855463