benchmarks/benchmark_prioritization.py · 8aca27fa11bfe0539b72002761add7d990af325e · OpenDAS / vllm_cscc

[Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when... · 8aca27fa

Robin authored Feb 22, 2025


[Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when max_model_len < input_len + output_len (#13691)
Signed-off-by: WangErXiao <863579016@qq.com>

8aca27fa

benchmark_prioritization.py 6.38 KB

Replace benchmark_prioritization.py