Skip to content

GitLab

Unverified Commit b7107d00 authored by ishandhanani's avatar ishandhanani Committed by GitHub
Browse files

fix: warmup for auto warmup (#4879)

parent 1c39e483
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/backends/sglang/slurm_jobs/scripts/vllm/bench.sh
View file @ b7107d00
...@@ -40,7 +40,7 @@ set -e ...@@ -40,7 +40,7 @@ set -e
warmup_isl=$chosen_isl warmup_isl=$chosen_isl
warmup_osl=$chosen_osl warmup_osl=$chosen_osl
warmup_req_rate=250 warmup_req_rate=250
warmup_concurrency_list=(1 4 8 32 64 128 256 512) warmup_concurrency_list=(1 4 32 128 256)
# Ensure all chosen concurrencies are in warmup list # Ensure all chosen concurrencies are in warmup list
for c in "${chosen_concurrencies[@]}"; do for c in "${chosen_concurrencies[@]}"; do
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment