Skip to content

GitLab

Unverified Commit 16429950 authored by Russell Bryant's avatar Russell Bryant Committed by GitHub
Browse files

[Benchmark] Fix regression in structured output benchmark (#25500) 


Signed-off-by: default avatarRussell Bryant <rbryant@redhat.com>
parent 58c360d9
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
benchmarks/benchmark_serving_structured_output.py
View file @ 16429950
...@@ -449,7 +449,8 @@ async def benchmark( ...@@ -449,7 +449,8 @@ async def benchmark(
def prepare_extra_body(request) -> dict: def prepare_extra_body(request) -> dict:
extra_body = {} extra_body = {}
# Add the schema to the extra_body # Add the schema to the extra_body
extra_body[request.structure_type] = request.schema extra_body["structured_outputs"] = {}
extra_body["structured_outputs"][request.structure_type] = request.schema
return extra_body return extra_body
print("Starting initial single prompt test run...") print("Starting initial single prompt test run...")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment