"...text-generation-inference.git" did not exist on "d077150eb7b9884f33e60abe99fe6359bf6e3e64"
Unverified Commit e3bf1825 authored by kylasa's avatar kylasa Committed by GitHub
Browse files

alltoall returns tensor list with None values, which is failing torch.cat(). (#4788)

parent 98b9e0fa
...@@ -310,6 +310,9 @@ class DistLookupService: ...@@ -310,6 +310,9 @@ class DistLookupService:
# Send the shuffle-global-nids to their respective ranks. # Send the shuffle-global-nids to their respective ranks.
mapped_global_nids = alltoallv_cpu(self.rank, self.world_size, shuffle_nids_list) mapped_global_nids = alltoallv_cpu(self.rank, self.world_size, shuffle_nids_list)
for idx in range(len(mapped_global_nids)):
if mapped_global_nids[idx] == None:
mapped_global_nids[idx] = torch.empty((0,), dtype=torch.int64)
# Reorder to match global_nids (function parameter). # Reorder to match global_nids (function parameter).
global_nids_order = np.concatenate(id_list) global_nids_order = np.concatenate(id_list)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment