Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
f8fcca10
Unverified
Commit
f8fcca10
authored
Jan 05, 2025
by
Rui Qiao
Committed by
GitHub
Jan 06, 2025
Browse files
[Misc] Fix typo for valid_tool_parses (#11753)
Signed-off-by:
Rui Qiao
<
ruisearch42@gmail.com
>
parent
06bfb519
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
vllm/entrypoints/openai/api_server.py
vllm/entrypoints/openai/api_server.py
+3
-3
No files found.
vllm/entrypoints/openai/api_server.py
View file @
f8fcca10
...
...
@@ -767,11 +767,11 @@ async def run_server(args, **uvicorn_kwargs) -> None:
if
args
.
tool_parser_plugin
and
len
(
args
.
tool_parser_plugin
)
>
3
:
ToolParserManager
.
import_tool_parser
(
args
.
tool_parser_plugin
)
valid
e
_tool_parses
=
ToolParserManager
.
tool_parsers
.
keys
()
valid_tool_parses
=
ToolParserManager
.
tool_parsers
.
keys
()
if
args
.
enable_auto_tool_choice
\
and
args
.
tool_call_parser
not
in
valid
e
_tool_parses
:
and
args
.
tool_call_parser
not
in
valid_tool_parses
:
raise
KeyError
(
f
"invalid tool call parser:
{
args
.
tool_call_parser
}
"
f
"(chose from {{
{
','
.
join
(
valid
e
_tool_parses
)
}
}})"
)
f
"(chose from {{
{
','
.
join
(
valid_tool_parses
)
}
}})"
)
# workaround to make sure that we bind the port before the engine is set up.
# This avoids race conditions with ray.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment