Unverified Commit be633fba authored by Chauncey's avatar Chauncey Committed by GitHub
Browse files

[Bugfix] Fix AttributeError: 'State' object has no attribute 'engine_client' (#17434)


Signed-off-by: default avatarchaunceyjiang <chaunceyjiang@gmail.com>
parent ed6cfb90
...@@ -111,7 +111,7 @@ async def init_app( ...@@ -111,7 +111,7 @@ async def init_app(
engine = (llm_engine engine = (llm_engine
if llm_engine is not None else AsyncLLMEngine.from_engine_args( if llm_engine is not None else AsyncLLMEngine.from_engine_args(
engine_args, usage_context=UsageContext.API_SERVER)) engine_args, usage_context=UsageContext.API_SERVER))
app.state.engine_client = engine
return app return app
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment