GitLab

Do not use GPU when importing transformers

XLNet for Token classification

CLI for authenticated file sharing

fix summary_type value of SequenceSummary

Co-Authored-By: Piero Molino <w4nderlust@gmail.com>

When evaluating, shouldn't we always use the SequentialSampler instead of DistributedSampler? Evaluation only runs on 1 GPU no matter what, so if you use the DistributedSampler with N GPUs, I think you'll only evaluate on 1/N of the evaluation set. That's at least what I'm finding when I run an older/modified version of this repo.

Co-Authored-By: Rosanne Liu <mimosavvy@gmail.com>

Imrpovements: model_path renamed pretrained_model, tokenizer loaded from pretrained_model, pretrained_model set to discriminator's when discrim is specified, sample = False by default but cli parameter introduced. To obtain identical samples call the cli with --sample

First cleanup step, changing function names and passing parameters all the way through without using args. Identical output as before.