Skip to content

GitLab

Unverified Commit 836d4ce1 authored by Chauncey's avatar Chauncey Committed by GitHub
Browse files

[Bugfix] fix missing 'finish_reason': null in streaming chat (#19662) 


Signed-off-by: default avatarchaunceyjiang <chaunceyjiang@gmail.com>
parent c3fec47b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/entrypoints/openai/serving_chat.py
View file @ 836d4ce1
......@@ -873,7 +873,7 @@ class OpenAIServingChat(OpenAIServing):
total_tokens=num_prompt_tokens + completion_tokens,
)
data = chunk.model_dump_json(exclude_none=True)
data = chunk.model_dump_json(exclude_unset=True)
yield f"data: {data}\n\n"
# once the final token is handled, if stream_options.include_usage
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment