Skip to content

GitLab

Unverified Commit 93491aef authored by yihong's avatar yihong Committed by GitHub
Browse files

[BugFix] make sure socket close (#15875) 


Signed-off-by: default avataryihong0618 <zouzou0208@gmail.com>
parent 7acd539c
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 3 deletions
vllm/entrypoints/openai/api_server.py
View file @ 93491aef
...@@ -1098,8 +1098,9 @@ async def run_server(args, **uvicorn_kwargs) -> None: ...@@ -1098,8 +1098,9 @@ async def run_server(args, **uvicorn_kwargs) -> None:
) )
# NB: Await server shutdown only after the backend context is exited # NB: Await server shutdown only after the backend context is exited
try:
await shutdown_task await shutdown_task
finally:
sock.close() sock.close()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment