Skip to content

GitLab

"examples/vscode:/vscode.git/clone" did not exist on "22b64948f6f4381bce7ac8ec0487020f0129e1cb"
Unverified Commit 836d4ce1 authored by Chauncey's avatar Chauncey Committed by GitHub
Browse files

[Bugfix] fix missing 'finish_reason': null in streaming chat (#19662) 


Signed-off-by: default avatarchaunceyjiang <chaunceyjiang@gmail.com>
parent c3fec47b
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/entrypoints/openai/serving_chat.py
View file @ 836d4ce1
...@@ -873,7 +873,7 @@ class OpenAIServingChat(OpenAIServing): ...@@ -873,7 +873,7 @@ class OpenAIServingChat(OpenAIServing):
total_tokens=num_prompt_tokens + completion_tokens, total_tokens=num_prompt_tokens + completion_tokens,
) )
data = chunk.model_dump_json(exclude_none=True) data = chunk.model_dump_json(exclude_unset=True)
yield f"data: {data}\n\n" yield f"data: {data}\n\n"
# once the final token is handled, if stream_options.include_usage # once the final token is handled, if stream_options.include_usage
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment