Skip to content

GitLab

Unverified Commit 067e77f9 authored by Sam Stoelinga's avatar Sam Stoelinga Committed by GitHub
Browse files

[Bugfix] Steaming continuous_usage_stats default to False (#9709) 


Signed-off-by: default avatarSam Stoelinga <sammiestoel@gmail.com>
parent 6567e137
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/entrypoints/openai/protocol.py
View file @ 067e77f9
...@@ -127,7 +127,7 @@ class ResponseFormat(OpenAIBaseModel): ...@@ -127,7 +127,7 @@ class ResponseFormat(OpenAIBaseModel):
class StreamOptions(OpenAIBaseModel): class StreamOptions(OpenAIBaseModel):
include_usage: Optional[bool] = True include_usage: Optional[bool] = True
continuous_usage_stats: Optional[bool] = True continuous_usage_stats: Optional[bool] = False
class FunctionDefinition(OpenAIBaseModel): class FunctionDefinition(OpenAIBaseModel):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment