benchmarks/benchmark_throughput.py · 9a5664d4a4d212a6ebad79b15b11eb8d3ab2a0b2 · OpenDAS / vllm_cscc

[Misc] Refactor benchmark_throughput.py (#9779) · 9a5664d4

lkchen authored Nov 04, 2024


Signed-off-by: Linkun Chen <github+anyscale@lkchen.net>
Co-authored-by: Linkun Chen <lkchen@github.com>
Co-authored-by: Linkun Chen <github+anyscale@lkchen.net>

9a5664d4

benchmark_throughput.py 14.3 KB

Replace benchmark_throughput.py