list tuple for string based multigpu collection

439dca55 · lintangsutawika · 99ce4eff · 439dca55
Commit 439dca55 authored Dec 29, 2023 by lintangsutawika
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

lm_eval/evaluator.py lm_eval/evaluator.py +1 -1

No files found.
--- a/lm_eval/evaluator.py
+++ b/lm_eval/evaluator.py
@@ -401,7 +401,7 @@ def evaluate(
            if type(items[0]) == tuple:
                numitem = len(items[0])

-            if isinstance(items[0], (str, list)):
+            if isinstance(items[0], (str, list, tuple)):
                # handle the string case
                gathered_items = [None] * lm.accelerator.num_processes
                torch.distributed.all_gather_object(gathered_items, items)