Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
dba95378
Unverified
Commit
dba95378
authored
Jan 06, 2026
by
Elvir Crnčević
Committed by
GitHub
Jan 06, 2026
Browse files
Report error log after vllm bench serve (#31808)
Signed-off-by:
Elvir Crncevic
<
elvircrn@gmail.com
>
parent
ada6f91d
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
0 deletions
+6
-0
vllm/benchmarks/serve.py
vllm/benchmarks/serve.py
+6
-0
No files found.
vllm/benchmarks/serve.py
View file @
dba95378
...
@@ -412,6 +412,12 @@ def calculate_metrics(
...
@@ -412,6 +412,12 @@ def calculate_metrics(
# Find the time range across all successful requests
# Find the time range across all successful requests
successful_outputs
=
[
output
for
output
in
outputs
if
output
.
success
]
successful_outputs
=
[
output
for
output
in
outputs
if
output
.
success
]
failed_outputs
=
[
output
for
output
in
outputs
if
not
output
.
success
]
failed_outputs
=
[
output
for
output
in
outputs
if
not
output
.
success
]
if
len
(
failed_outputs
)
>
0
:
print
(
"Failed requests during benchmark run detected (capping to 10):"
)
for
i
,
err
in
enumerate
(
failed_outputs
[:
10
]):
print
(
f
"Error
{
i
}
:
{
err
.
error
}
"
)
if
successful_outputs
:
if
successful_outputs
:
min_start_time
=
min
(
output
.
start_time
for
output
in
successful_outputs
)
min_start_time
=
min
(
output
.
start_time
for
output
in
successful_outputs
)
max_end_time
=
max
(
max_end_time
=
max
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment