Unverified Commit 9da9208b authored by baonudesifeizhai's avatar baonudesifeizhai Committed by GitHub
Browse files

[Bug] Fix missing token_ids for reasoning parser models in chat completions #28246 (#28256)

parent 11fd69dd
......@@ -1372,6 +1372,9 @@ class OpenAIServingChat(OpenAIServing):
else "stop"
),
stop_reason=output.stop_reason,
token_ids=(
as_list(output.token_ids) if request.return_token_ids else None
),
)
choices.append(choice_data)
continue
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment