Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
16429950
Unverified
Commit
16429950
authored
Sep 24, 2025
by
Russell Bryant
Committed by
GitHub
Sep 24, 2025
Browse files
[Benchmark] Fix regression in structured output benchmark (#25500)
Signed-off-by:
Russell Bryant
<
rbryant@redhat.com
>
parent
58c360d9
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
benchmarks/benchmark_serving_structured_output.py
benchmarks/benchmark_serving_structured_output.py
+2
-1
No files found.
benchmarks/benchmark_serving_structured_output.py
View file @
16429950
...
...
@@ -449,7 +449,8 @@ async def benchmark(
def
prepare_extra_body
(
request
)
->
dict
:
extra_body
=
{}
# Add the schema to the extra_body
extra_body
[
request
.
structure_type
]
=
request
.
schema
extra_body
[
"structured_outputs"
]
=
{}
extra_body
[
"structured_outputs"
][
request
.
structure_type
]
=
request
.
schema
return
extra_body
print
(
"Starting initial single prompt test run..."
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment