benchmarks/benchmark_latency.py · 8aca27fa11bfe0539b72002761add7d990af325e · OpenDAS / vllm_cscc

[Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when... · 8aca27fa

Robin authored Feb 22, 2025


[Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when max_model_len < input_len + output_len (#13691)
Signed-off-by: WangErXiao <863579016@qq.com>

8aca27fa

benchmark_latency.py 6.16 KB

Replace benchmark_latency.py