GitLab

* Switch to plain unittest for skipping slow tests.

Add a RUN_SLOW environment variable for running them.

* Switch to plain unittest for PyTorch dependency.

* Switch to plain unittest for TensorFlow dependency.

* Avoid leaking open files in the test suite.

This prevents spurious warnings when running tests.

* Fix unicode warning on Python 2 when running tests.

The warning was:

    UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal

* Support running PyTorch tests on a GPU.

Reverts 27e015bd.

* Tests no longer require pytest.

* Make tests pass on cuda

* [cli] Uploads: add progress bar

see https://github.com/huggingface/transformers/pull/2044#discussion_r354057827 for context

* rename + documentation

* Add auto-referential comment

corrected documentation for past tensor shape for ctrl and gpt2 model

Add NER TF2 example.

Nicer error message when Bert's input is missing batch size

* license

* changes

* ok

* Update paper link and commands to run

* pointer to uber repo

Remove dead code in tests.

Fixing camembert tokenization

typo fix on the docs as per Pytorch v1.1+

fixed XLNet attention output for both attention streams whenever target_mapping is provided

Do not use GPU when importing transformers

XLNet for Token classification

CLI for authenticated file sharing

fix summary_type value of SequenceSummary

Create a NER example similar to the Pytorch one. It takes the same options, and can be run the same way.

Co-Authored-By: Piero Molino <w4nderlust@gmail.com>

When evaluating, shouldn't we always use the SequentialSampler instead of DistributedSampler? Evaluation only runs on 1 GPU no matter what, so if you use the DistributedSampler with N GPUs, I think you'll only evaluate on 1/N of the evaluation set. That's at least what I'm finding when I run an older/modified version of this repo.