Commit 439dca55 authored by lintangsutawika's avatar lintangsutawika
Browse files

list tuple for string based multigpu collection

parent 99ce4eff
...@@ -401,7 +401,7 @@ def evaluate( ...@@ -401,7 +401,7 @@ def evaluate(
if type(items[0]) == tuple: if type(items[0]) == tuple:
numitem = len(items[0]) numitem = len(items[0])
if isinstance(items[0], (str, list)): if isinstance(items[0], (str, list, tuple)):
# handle the string case # handle the string case
gathered_items = [None] * lm.accelerator.num_processes gathered_items = [None] * lm.accelerator.num_processes
torch.distributed.all_gather_object(gathered_items, items) torch.distributed.all_gather_object(gathered_items, items)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment