Skip to content

GitLab

Unverified Commit 932b51ce authored by youkaichao's avatar youkaichao Committed by GitHub
Browse files

[v1] fix parallel config rank (#13445) 


Signed-off-by: default avataryoukaichao <youkaichao@gmail.com>
parent 7c7adf81
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/v1/worker/worker_base.py
View file @ 932b51ce
...@@ -41,6 +41,7 @@ class WorkerBase(WorkerBaseV0): ...@@ -41,6 +41,7 @@ class WorkerBase(WorkerBaseV0):
# Configuration storage # Configuration storage
super().__init__(vllm_config=vllm_config) super().__init__(vllm_config=vllm_config)
self.parallel_config.rank = rank
self.local_rank = local_rank self.local_rank = local_rank
self.rank = rank self.rank = rank
self.distributed_init_method = distributed_init_method self.distributed_init_method = distributed_init_method
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment