Commit e6492441 authored by Benjamin Fattori's avatar Benjamin Fattori
Browse files

world_size condition for padding

parent 074099f9
...@@ -167,7 +167,7 @@ def evaluate( ...@@ -167,7 +167,7 @@ def evaluate(
for req in reqs: for req in reqs:
cloned_reqs.extend([req] * req.repeats) cloned_reqs.extend([req] * req.repeats)
if (numpad > 0): if (lm.world_size > 1) and (numpad > 0):
for _ in range(numpad): for _ in range(numpad):
cloned_reqs.extend([req] * req.repeats) cloned_reqs.extend([req] * req.repeats)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment