Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "f1cc6157210abd9ea953da097fb704a1dd778638"
Commit 45634f87 authored by Victor SANH's avatar Victor SANH Committed by Lysandre Debut
Browse files

fix Sampler in distributed training - evaluation

parent af1ee9e6
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/distillation/run_squad_w_distillation.py
View file @ 45634f87
...@@ -264,7 +264,7 @@ def evaluate(args, model, tokenizer, prefix=""): ...@@ -264,7 +264,7 @@ def evaluate(args, model, tokenizer, prefix=""):
args.eval_batch_size = args.per_gpu_eval_batch_size * max(1, args.n_gpu) args.eval_batch_size = args.per_gpu_eval_batch_size * max(1, args.n_gpu)
# Note that DistributedSampler samples randomly # Note that DistributedSampler samples randomly
eval_sampler = SequentialSampler(dataset) if args.local_rank == -1 else DistributedSampler(dataset) eval_sampler = SequentialSampler(dataset)
eval_dataloader = DataLoader(dataset, sampler=eval_sampler, batch_size=args.eval_batch_size) eval_dataloader = DataLoader(dataset, sampler=eval_sampler, batch_size=args.eval_batch_size)
# Eval! # Eval!
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment