Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "9c1baa5bc6caedabeac1a6da57ec79b41e13056d"
Unverified Commit d2339d68 authored by Nick Hill's avatar Nick Hill Committed by GitHub
Browse files

Connect engine healthcheck to openai server (#3260)

parent b35cc934
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/entrypoints/openai/api_server.py
View file @ d2339d68
...@@ -160,6 +160,7 @@ async def validation_exception_handler(_, exc): ...@@ -160,6 +160,7 @@ async def validation_exception_handler(_, exc):
@app.get("/health") @app.get("/health")
async def health() -> Response: async def health() -> Response:
"""Health check.""" """Health check."""
await openai_serving_chat.engine.check_health()
return Response(status_code=200) return Response(status_code=200)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment