Unverified Commit ca533580 authored by 江家瑋's avatar 江家瑋 Committed by GitHub
Browse files

[Docs] Correct and clarify notes in Engine docstring (#9313)


Signed-off-by: default avatarJiangJiaWei1103 <waynechuang97@gmail.com>
parent 886454e8
...@@ -94,8 +94,8 @@ class Engine(EngineBase): ...@@ -94,8 +94,8 @@ class Engine(EngineBase):
3. DetokenizerManager (subprocess): Detokenizes the output tokens and sends the result back to the Tokenizer Manager. 3. DetokenizerManager (subprocess): Detokenizes the output tokens and sends the result back to the Tokenizer Manager.
Note: Note:
1. The HTTP server, Engine, and TokenizerManager both run in the main process. 1. The HTTP server, Engine, and TokenizerManager all run in the main process.
2. Inter-process communication is done through ICP (each process uses a different port) via the ZMQ library. 2. Inter-process communication (IPC) is handled via the ZMQ library, with each process using a different port.
""" """
def __init__(self, **kwargs): def __init__(self, **kwargs):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment