Skip to content

GitLab

"vllm/v1/engine/input_processor.py" did not exist on "57430fc95c8a94a7c68b3d525e3b8823b0f2433f"
Unverified Commit 9da9208b authored by baonudesifeizhai's avatar baonudesifeizhai Committed by GitHub
Browse files

[Bug] Fix missing token_ids for reasoning parser models in chat completions #28246 (#28256)

parent 11fd69dd
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
vllm/entrypoints/openai/serving_chat.py
View file @ 9da9208b
...@@ -1372,6 +1372,9 @@ class OpenAIServingChat(OpenAIServing): ...@@ -1372,6 +1372,9 @@ class OpenAIServingChat(OpenAIServing):
else "stop" else "stop"
), ),
stop_reason=output.stop_reason, stop_reason=output.stop_reason,
token_ids=(
as_list(output.token_ids) if request.return_token_ids else None
),
) )
choices.append(choice_data) choices.append(choice_data)
continue continue
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment