Unverified Commit 68dbde5d authored by Cheng Kuan Yong Jason's avatar Cheng Kuan Yong Jason Committed by GitHub
Browse files

[Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312)


Signed-off-by: default avatarJason Cheng <jasoncky96@gmail.com>
Co-authored-by: default avatarChauncey <chaunceyjiang@gmail.com>
parent 04ad0dc2
......@@ -828,9 +828,6 @@ class OpenAIServingChat(OpenAIServing):
history_tool_call_cnt += 1
tools_streamed[i] = True
# update the previous values for the next iteration
previous_texts[i] = current_text
# handle streaming deltas for tools with "auto" tool choice
# and reasoning parser
elif tool_choice_auto and self.reasoning_parser:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment