Unverified Commit 541c1852 authored by Robert Shaw's avatar Robert Shaw Committed by GitHub
Browse files

[ BugFix ] Fix ZMQ when `VLLM_PORT` is set (#7205)

parent a3bbbfa1
...@@ -145,7 +145,7 @@ environment_variables: Dict[str, Callable[[], Any]] = { ...@@ -145,7 +145,7 @@ environment_variables: Dict[str, Callable[[], Any]] = {
# used when the frontend api server is running in multi-processing mode, # used when the frontend api server is running in multi-processing mode,
# to communicate with the backend engine process over ZMQ. # to communicate with the backend engine process over ZMQ.
'VLLM_RPC_PORT': 'VLLM_RPC_PORT':
lambda: int(os.getenv('VLLM_PORT', '5570')), lambda: int(os.getenv('VLLM_RPC_PORT', '5570')),
# If true, will load models from ModelScope instead of Hugging Face Hub. # If true, will load models from ModelScope instead of Hugging Face Hub.
# note that the value is true or false, not numbers # note that the value is true or false, not numbers
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment