Skip to content

GitLab

Unverified Commit 7508a3dc authored by Thomas Parnell's avatar Thomas Parnell Committed by GitHub
Browse files

[Misc] Fix typos in spec. decode metrics logging. (#6470) 


Signed-off-by: default avatarThomas Parnell <tpa@zurich.ibm.com>
parent 7a3d2a5b
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
vllm/engine/metrics.py
View file @ 7508a3dc
...@@ -325,8 +325,8 @@ class LoggingStatLogger(StatLoggerBase): ...@@ -325,8 +325,8 @@ class LoggingStatLogger(StatLoggerBase):
f"System efficiency: {metrics.system_efficiency:.3f}, " f"System efficiency: {metrics.system_efficiency:.3f}, "
f"Number of speculative tokens: {metrics.num_spec_tokens}, " f"Number of speculative tokens: {metrics.num_spec_tokens}, "
f"Number of accepted tokens: {metrics.accepted_tokens}, " f"Number of accepted tokens: {metrics.accepted_tokens}, "
f"Number of draft tokens tokens: {metrics.draft_tokens}, " f"Number of draft tokens: {metrics.draft_tokens}, "
f"Number of emitted tokens tokens: {metrics.emitted_tokens}.") f"Number of emitted tokens: {metrics.emitted_tokens}.")
class PrometheusStatLogger(StatLoggerBase): class PrometheusStatLogger(StatLoggerBase):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment