Skip to content

GitLab

Unverified Commit 5a60699c authored by tomeras91's avatar tomeras91 Committed by GitHub
Browse files

[Bugfix]: Fix the logic for deciding if tool parsing is used (#8366)

parent b6c75e1c
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/entrypoints/openai/serving_chat.py
View file @ 5a60699c
...@@ -607,7 +607,7 @@ class OpenAIServingChat(OpenAIServing): ...@@ -607,7 +607,7 @@ class OpenAIServingChat(OpenAIServing):
# if auto tools are not enabled, and a named tool choice using # if auto tools are not enabled, and a named tool choice using
# outlines is not being used # outlines is not being used
if not (self.enable_auto_tools if (not self.enable_auto_tools
or not self.tool_parser) and not isinstance( or not self.tool_parser) and not isinstance(
request.tool_choice, request.tool_choice,
ChatCompletionNamedToolChoiceParam): ChatCompletionNamedToolChoiceParam):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment