• Ethan Perez's avatar
    Always use SequentialSampler during evaluation · 96e83506
    Ethan Perez authored
    When evaluating, shouldn't we always use the SequentialSampler instead of DistributedSampler? Evaluation only runs on 1 GPU no matter what, so if you use the DistributedSampler with N GPUs, I think you'll only evaluate on 1/N of the evaluation set. That's at least what I'm finding when I run an older/modified version of this repo.
    96e83506
run_squad.py 31 KB