Skip to content

GitLab

Unverified Commit 49996cd5 authored by Peter Pan's avatar Peter Pan Committed by GitHub
Browse files

[env] default nixl side port conflicts with kv-event zmq port (#25056) 


Signed-off-by: default avatarPeter Pan <Peter.Pan@daocloud.io>
parent ecb37e27
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/envs.py
View file @ 49996cd5
...@@ -155,7 +155,7 @@ if TYPE_CHECKING: ...@@ -155,7 +155,7 @@ if TYPE_CHECKING:
VLLM_MSGPACK_ZERO_COPY_THRESHOLD: int = 256 VLLM_MSGPACK_ZERO_COPY_THRESHOLD: int = 256
VLLM_ALLOW_INSECURE_SERIALIZATION: bool = False VLLM_ALLOW_INSECURE_SERIALIZATION: bool = False
VLLM_NIXL_SIDE_CHANNEL_HOST: str = "localhost" VLLM_NIXL_SIDE_CHANNEL_HOST: str = "localhost"
VLLM_NIXL_SIDE_CHANNEL_PORT: int = 5557 VLLM_NIXL_SIDE_CHANNEL_PORT: int = 5600
VLLM_ALL2ALL_BACKEND: Literal["naive", "pplx", VLLM_ALL2ALL_BACKEND: Literal["naive", "pplx",
"deepep_high_throughput", "deepep_high_throughput",
"deepep_low_latency", "deepep_low_latency",
...@@ -1220,7 +1220,7 @@ environment_variables: dict[str, Callable[[], Any]] = { ...@@ -1220,7 +1220,7 @@ environment_variables: dict[str, Callable[[], Any]] = {
# Port used for NIXL handshake between remote agents. # Port used for NIXL handshake between remote agents.
"VLLM_NIXL_SIDE_CHANNEL_PORT": "VLLM_NIXL_SIDE_CHANNEL_PORT":
lambda: int(os.getenv("VLLM_NIXL_SIDE_CHANNEL_PORT", "5557")), lambda: int(os.getenv("VLLM_NIXL_SIDE_CHANNEL_PORT", "5600")),
# all2all backend for vllm's expert parallel communication # all2all backend for vllm's expert parallel communication
# Available options: # Available options:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment