Skip to content

GitLab

Unverified Commit 87f545ba authored by Roy's avatar Roy Committed by GitHub
Browse files

[Misc] Fix logger format typo (#4396)

parent 8947bc3c
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/engine/metrics.py
View file @ 87f545ba
...@@ -230,8 +230,8 @@ class StatLogger: ...@@ -230,8 +230,8 @@ class StatLogger:
"Avg prompt throughput: %.1f tokens/s, " "Avg prompt throughput: %.1f tokens/s, "
"Avg generation throughput: %.1f tokens/s, " "Avg generation throughput: %.1f tokens/s, "
"Running: %d reqs, Swapped: %d reqs, " "Running: %d reqs, Swapped: %d reqs, "
"Pending: %d reqs, GPU KV cache usage: %.1f%, " "Pending: %d reqs, GPU KV cache usage: %.1f%%, "
"CPU KV cache usage: %.1f%", "CPU KV cache usage: %.1f%%",
prompt_throughput, prompt_throughput,
generation_throughput, generation_throughput,
stats.num_running, stats.num_running,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment