GitLab

Remove dead code in tests.

Fixing camembert tokenization

typo fix on the docs as per Pytorch v1.1+

fixed XLNet attention output for both attention streams whenever target_mapping is provided

Do not use GPU when importing transformers

XLNet for Token classification

CLI for authenticated file sharing

fix summary_type value of SequenceSummary

Co-Authored-By: Piero Molino <w4nderlust@gmail.com>

When evaluating, shouldn't we always use the SequentialSampler instead of DistributedSampler? Evaluation only runs on 1 GPU no matter what, so if you use the DistributedSampler with N GPUs, I think you'll only evaluate on 1/N of the evaluation set. That's at least what I'm finding when I run an older/modified version of this repo.

Co-Authored-By: Rosanne Liu <mimosavvy@gmail.com>

Imrpovements: model_path renamed pretrained_model, tokenizer loaded from pretrained_model, pretrained_model set to discriminator's when discrim is specified, sample = False by default but cli parameter introduced. To obtain identical samples call the cli with --sample