Skip to content

GitLab

Unverified Commit b2c3fc5d authored by Isotr0py's avatar Isotr0py Committed by GitHub
Browse files

[Bugfix][CPU] Fix cpu all-reduce using native pytorch implementation (#13586)

parent 839b27c6
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/distributed/device_communicators/cpu_communicator.py
View file @ b2c3fc5d
...@@ -30,4 +30,5 @@ class CpuCommunicator(DeviceCommunicatorBase): ...@@ -30,4 +30,5 @@ class CpuCommunicator(DeviceCommunicatorBase):
pass pass
def all_reduce(self, input_): def all_reduce(self, input_):
return self.dist_module.all_reduce(input_, group=self.device_group) self.dist_module.all_reduce(input_, group=self.device_group)
return input_
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment