2024-12-13 11:06:41,463 - INFO - *******batch_size: 1  *******QPS: 35.06600693176453
2024-12-13 11:07:14,337 - INFO - *******batch_size: 2  *******QPS: 70.24940995568168
2024-12-13 11:07:47,378 - INFO - *******batch_size: 4  *******QPS: 140.09885255114204
2024-12-13 11:08:20,723 - INFO - *******batch_size: 8  *******QPS: 279.6745328485237
2024-12-13 11:08:54,667 - INFO - *******batch_size: 16  *******QPS: 554.4031303992693
2024-12-13 11:09:30,433 - INFO - *******batch_size: 32  *******QPS: 1077.4658563095725
2024-12-13 11:10:10,854 - INFO - *******batch_size: 64  *******QPS: 1969.1841524765305
2024-12-13 11:10:56,437 - INFO - *******batch_size: 128  *******QPS: 3740.1818182147513
2024-12-13 11:11:51,457 - INFO - *******batch_size: 256  *******QPS: 6942.585605124668
2024-12-13 11:13:07,836 - INFO - *******batch_size: 512  *******QPS: 11550.409709195043
2024-12-13 11:15:10,609 - INFO - *******batch_size: 1024  *******QPS: 16354.299500589199
2024-12-13 11:18:41,208 - INFO - *******batch_size: 2048  *******QPS: 21661.6392544352