GitLab

* First commit to add a TF version of the trainer.

* Make the TF trainer closer to what looks the PT trainer

* Refactoring common code between the PT and TF trainer into an util file.

* Some bugfix + better similarity with the PT trainer

* Add missing class in transformers init

* Bugfix over prediction + use classification report instead of simple metrics

* Fix name error

* Fix optimization tests + style

* Apply style

* Several bugfix for multi-gpu training

* Apply style

* Apply style

* Add glue example for the TF trainer

* Several bugix + address the reviews

* Fix on the TF training args file

* Add a debug mode

* Bugfix in utils_ner.py when segment_ids is None

* Apply style

* Apply style

* Add TPU strategy

* Fix selection strategy

Description for the model card describing the camembert-large-fquad model.

See https://github.com/huggingface/transformers/pull/3916

* Standard deviation can no longer be set to 0

* Remove torch pinned version

* 9th instead of 10th, silly me

* feat: add logging through Weights & Biases

* feat(wandb): make logging compatible with all scripts

* style(trainer.py): fix formatting

* [Trainer] Tweak wandb integration
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Hoist bert model tester for patric

* indent

* make tests work

* Update tests/test_modeling_bert.py
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
Co-authored-by: sshleifer <sshleifer@gmail.com>
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Fix of issue #2941

Reshaped score array to avoid `numpy` ValueError.

* Update src/transformers/pipelines.py

* Update src/transformers/pipelines.py
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Create model card

Create Model card for distilroberta-base-finetuned-sentiment

* Update model_cards/mrm8488/distilroberta-base-finetuned-sentiment/README.md

* Update model_cards/mrm8488/distilroberta-base-finetuned-sentiment/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* Create README.md

* Update model_cards/surajp/albert-base-sanskrit/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

* ner: parse args from .args file or JSON

* examples: mention json-based configuration file support for run_ner script

* correct model card

* remove model card from patrick von platen

* Create GePpeTto.md

* Update model_cards/LorenzoDeMattei/GePpeTto.md

* Update model_cards/LorenzoDeMattei/GePpeTto.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

[qol] example scripts: parse args from .args file or JSON

There's an inconsistency right now where:
- we load some models into CACHE_DIR
- and some models in the default cache
- and often, in both for the same models

When running the RUN_SLOW tests, this takes a lot of disk space, time, and bandwidth.

I'd rather always use the default cache

* Create README.md

* Update README.md

* tweak
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

(cherry picked from commit a4a673a1d0bec0bf4085eef021acb788ca1f5eb5)