解决custom allreduce在dp情况下的其服务错误问题

ef5ebdbf · zhuwenwen · 5e19613e · ef5ebdbf
Commit ef5ebdbf authored Jan 08, 2026 by zhuwenwen
Hide whitespace changes
Inline Side-by-side

Showing with 5 additions and 1 deletion

vllm/distributed/device_communicators/custom_all_reduce.py vllm/distributed/device_communicators/custom_all_reduce.py +5 -1

No files found.
--- a/vllm/distributed/device_communicators/custom_all_reduce.py
+++ b/vllm/distributed/device_communicators/custom_all_reduce.py
@@ -128,7 +128,11 @@ class CustomAllreduce:
        else:
            device_ids = list(range(cuda_device_count_stateless()))

-        physical_device_id = device_ids[device.index]
+        if (world_size == len(device_ids)):
+            physical_device_id = device_ids[device.index % world_size]
+        else:
+            physical_device_id = device_ids[device.index]
+
        tensor = torch.tensor([physical_device_id],
                              dtype=torch.int,
                              device="cpu")