benchmarks/benchmark_serving.py · c635c5f7448f7ee5593c2ad7bb447b3aa1bc6d47 · OpenDAS / vllm_cscc · GitLab

"vscode:/vscode.git/clone" did not exist on "5e973209aaf5fa15459555eaa42bcd20ea63aa0d"

Find file Blame History Permalink

[Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7

d.transposed authored Jun 24, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>

c635c5f7

benchmark_serving.py 48.9 KB