[v1] fix parallel config rank (#13445)

Signed-off-by: youkaichao <youkaichao@gmail.com>

[v1] fix parallel config rank (#13445)
Signed-off-by: youkaichao <youkaichao@gmail.com>
932b51ce · youkaichao · GitHub · 7c7adf81 · 932b51ce
Unverified Commit 932b51ce authored Feb 18, 2025 by youkaichao Committed by GitHub Feb 18, 2025
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

vllm/v1/worker/worker_base.py vllm/v1/worker/worker_base.py +1 -0

No files found.
--- a/vllm/v1/worker/worker_base.py
+++ b/vllm/v1/worker/worker_base.py
@@ -41,6 +41,7 @@ class WorkerBase(WorkerBaseV0):
        # Configuration storage
        super().__init__(vllm_config=vllm_config)

+        self.parallel_config.rank = rank
        self.local_rank = local_rank
        self.rank = rank
        self.distributed_init_method = distributed_init_method