Skip to content

GitLab

Unverified Commit fba03b29 authored by shangmingc's avatar shangmingc Committed by GitHub
Browse files

[Bugfix] Fix missing abort finish reason for PD with ChatCompletion (#6693) 


Signed-off-by: default avatarShangming Cai <caishangming@linux.alibaba.com>
parent 461a7302
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/openai_api/protocol.py
View file @ fba03b29
...@@ -413,7 +413,7 @@ class ChatCompletionResponseChoice(BaseModel): ...@@ -413,7 +413,7 @@ class ChatCompletionResponseChoice(BaseModel):
message: ChatMessage message: ChatMessage
logprobs: Optional[Union[LogProbs, ChoiceLogprobs]] = None logprobs: Optional[Union[LogProbs, ChoiceLogprobs]] = None
finish_reason: Literal[ finish_reason: Literal[
"stop", "length", "tool_calls", "content_filter", "function_call" "stop", "length", "tool_calls", "content_filter", "function_call", "abort"
] ]
matched_stop: Union[None, int, str] = None matched_stop: Union[None, int, str] = None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment