Skip to content

GitLab

Unverified Commit 429284dc authored by Junda Chen's avatar Junda Chen Committed by GitHub
Browse files

Fix `dist.broadcast` stall without group argument (#3408)

parent 253a9807
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/parallel_utils/communication_op.py
View file @ 429284dc
...@@ -177,7 +177,7 @@ def broadcast_tensor_dict( ...@@ -177,7 +177,7 @@ def broadcast_tensor_dict(
for key, value in metadata_list: for key, value in metadata_list:
if isinstance(value, TensorMetadata): if isinstance(value, TensorMetadata):
tensor = tensor_dict[key] tensor = tensor_dict[key]
torch.distributed.broadcast(tensor, src=src) torch.distributed.broadcast(tensor, src=src, group=group)
else: else:
recv_metadata_list = [None] recv_metadata_list = [None]
torch.distributed.broadcast_object_list(recv_metadata_list, torch.distributed.broadcast_object_list(recv_metadata_list,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment