Unverified Commit e74f2d44 authored by Cyrus Leung's avatar Cyrus Leung Committed by GitHub
Browse files

[Doc] Specify async engine args in docs (#9726)

parent 7a4df5f2
......@@ -999,6 +999,7 @@ class AsyncLLMEngine(EngineClient):
>>> # the complete example.
>>>
>>> # initialize the engine and the example input
>>> # note that engine_args here is AsyncEngineArgs instance
>>> engine = AsyncLLMEngine.from_engine_args(engine_args)
>>> example_input = {
>>> "prompt": "What is LLM?",
......@@ -1082,6 +1083,7 @@ class AsyncLLMEngine(EngineClient):
>>> # the complete example.
>>>
>>> # initialize the engine and the example input
>>> # note that engine_args here is AsyncEngineArgs instance
>>> engine = AsyncLLMEngine.from_engine_args(engine_args)
>>> example_input = {
>>> "input": "What is LLM?",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment