[Bugfix][CPU] Fix broken AVX2 CPU TP support (#17252)

Signed-off-by: Isotr0py <2037008807@qq.com>

[Bugfix][CPU] Fix broken AVX2 CPU TP support (#17252)
Signed-off-by: Isotr0py <2037008807@qq.com>
6e4a93e3 · Isotr0py · GitHub · 217db4ba · 6e4a93e3
Unverified Commit 6e4a93e3 authored May 09, 2025 by Isotr0py Committed by GitHub May 09, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 1 deletion

vllm/distributed/device_communicators/cpu_communicator.py vllm/distributed/device_communicators/cpu_communicator.py +2 -1

No files found.
--- a/vllm/distributed/device_communicators/cpu_communicator.py
+++ b/vllm/distributed/device_communicators/cpu_communicator.py
@@ -22,7 +22,8 @@ class CpuCommunicator(DeviceCommunicatorBase):
        super().__init__(cpu_group, device, device_group, unique_name)
        self.dist_module = torch.distributed

-        if current_platform.get_cpu_architecture() == CpuArchEnum.X86:
+        if (current_platform.get_cpu_architecture() == CpuArchEnum.X86) \
+            and hasattr(torch.ops._C, "init_shm_manager"):
            self.dist_module = _CPUSHMDistributed(self)

    def all_reduce(self, input_):