Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
432d6dad
Unverified
Commit
432d6dad
authored
Mar 10, 2025
by
Russell Bryant
Committed by
GitHub
Mar 10, 2025
Browse files
Fix typo in benchmark_serving_structured_output.py (#14566)
Signed-off-by:
Russell Bryant
<
rbryant@redhat.com
>
parent
5ff0d325
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
6 deletions
+5
-6
benchmarks/benchmark_serving_structured_output.py
benchmarks/benchmark_serving_structured_output.py
+5
-6
No files found.
benchmarks/benchmark_serving_structured_output.py
View file @
432d6dad
...
@@ -989,12 +989,11 @@ if __name__ == "__main__":
...
@@ -989,12 +989,11 @@ if __name__ == "__main__":
type
=
float
,
type
=
float
,
default
=
1.0
,
default
=
1.0
,
help
=
"Ratio of Structured Outputs requests"
)
help
=
"Ratio of Structured Outputs requests"
)
parser
.
add_argument
(
parser
.
add_argument
(
"--structured-output-backend"
,
"--structured-output-backend"
,
type
=
str
,
type
=
str
,
choices
=
[
"outlines"
,
"lm-format-enforcer"
,
"xgrammar"
],
choices
=
[
"outlines"
,
"lm-format-enforcer"
,
"xgrammar"
,
"json-unique"
],
default
=
"xgrammar"
,
default
=
"xgrammar"
,
help
=
"Backend to use for structured outputs"
)
help
=
"Backend to use for structured outputs"
)
args
=
parser
.
parse_args
()
args
=
parser
.
parse_args
()
main
(
args
)
main
(
args
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment