2024-12-13 11:56:16,487 - INFO - *******batch_size: 1 *******QPS: 28.448957120137806 2024-12-13 11:56:22,631 - INFO - *******batch_size: 2 *******QPS: 57.570425495453755 2024-12-13 11:56:28,761 - INFO - *******batch_size: 4 *******QPS: 116.83688591262103 2024-12-13 11:56:35,177 - INFO - *******batch_size: 8 *******QPS: 233.79212083177754 2024-12-13 11:56:41,912 - INFO - *******batch_size: 16 *******QPS: 463.97575531809497 2024-12-13 11:56:49,645 - INFO - *******batch_size: 32 *******QPS: 896.9596216319421 2024-12-13 11:56:59,165 - INFO - *******batch_size: 64 *******QPS: 1742.9214595545645 2024-12-13 11:57:12,276 - INFO - *******batch_size: 128 *******QPS: 3206.6887183008753 2024-12-13 11:57:32,150 - INFO - *******batch_size: 256 *******QPS: 6083.028168359787 2024-12-13 11:58:05,851 - INFO - *******batch_size: 512 *******QPS: 10230.784667855463
