Skip to content

GitLab

Unverified Commit 6211b922 authored by Robin's avatar Robin Committed by GitHub
Browse files

[Bugfix]Fix index out of range error in api server log (#16787) 


Signed-off-by: default avatarWangErXiao <863579016@qq.com>
parent 05fcd1b4
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/entrypoints/openai/api_server.py
View file @ 6211b922
...@@ -881,7 +881,8 @@ def build_app(args: Namespace) -> FastAPI: ...@@ -881,7 +881,8 @@ def build_app(args: Namespace) -> FastAPI:
section async for section in response.body_iterator section async for section in response.body_iterator
] ]
response.body_iterator = iterate_in_threadpool(iter(response_body)) response.body_iterator = iterate_in_threadpool(iter(response_body))
logger.info("response_body={%s}", response_body[0].decode()) logger.info("response_body={%s}",
response_body[0].decode() if response_body else None)
return response return response
for middleware in args.middleware: for middleware in args.middleware:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment