Unverified Commit 9da9208b authored by baonudesifeizhai's avatar baonudesifeizhai Committed by GitHub
Browse files

[Bug] Fix missing token_ids for reasoning parser models in chat completions #28246 (#28256)

parent 11fd69dd
...@@ -1372,6 +1372,9 @@ class OpenAIServingChat(OpenAIServing): ...@@ -1372,6 +1372,9 @@ class OpenAIServingChat(OpenAIServing):
else "stop" else "stop"
), ),
stop_reason=output.stop_reason, stop_reason=output.stop_reason,
token_ids=(
as_list(output.token_ids) if request.return_token_ids else None
),
) )
choices.append(choice_data) choices.append(choice_data)
continue continue
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment