Commits · aad50151f35b934039c455242c433a24f011cc93 · chenpangpang / transformers

"examples/token-classification/run_pl_ner.py" did not exist on "908fa43b543cf52a3238129624f502240725a6a6"

06 May, 2020 6 commits

TF version of the trainer (#4017) · aad50151

Julien Plu authored May 06, 2020

* First commit to add a TF version of the trainer.

* Make the TF trainer closer to what looks the PT trainer

* Refactoring common code between the PT and TF trainer into an util file.

* Some bugfix + better similarity with the PT trainer

* Add missing class in transformers init

* Bugfix over prediction + use classification report instead of simple metrics

* Fix name error

* Fix optimization tests + style

* Apply style

* Several bugfix for multi-gpu training

* Apply style

* Apply style

* Add glue example for the TF trainer

* Several bugix + address the reviews

* Fix on the TF training args file

* Add a debug mode

* Bugfix in utils_ner.py when segment_ids is None

* Apply style

* Apply style

* Add TPU strategy

* Fix selection strategy

aad50151

Fix overwrite_cache behaviour for pytorch lightning examples (#4093) · 25296b12
Simone Primarosa authored May 06, 2020

25296b12
Include ElectraPreTrainedModel into __init__ (#4173) · 9972562d
kumapo authored May 07, 2020

9972562d
Camembert-large-fquad model card (#4143) · ff8ed52d
martindh authored May 06, 2020
```
Description for the model card describing the camembert-large-fquad model.
```
ff8ed52d
Add model card for the NER model (#4162) · 4c3be2e7
Julien Plu authored May 06, 2020

4c3be2e7
Fix markdown to show the results table properly (#4119) · 17ae0363
Manuel Romero authored May 06, 2020

17ae0363

05 May, 2020 4 commits

fix hard wired pad token id (#4138) · a638e986
Patrick von Platen authored May 06, 2020

a638e986
[Trainer] W&B: Enable model watch · fd217466
Julien Chaumond authored May 05, 2020
```
See https://github.com/huggingface/transformers/pull/3916
```
fd217466

Pytorch 1.5.0 (#3973) · 79b1c696

Lysandre Debut authored May 05, 2020

* Standard deviation can no longer be set to 0

* Remove torch pinned version

* 9th instead of 10th, silly me

79b1c696

Trainer: add logging through Weights & Biases (#3916) · 818463ee

Boris Dayma authored May 04, 2020



* feat: add logging through Weights & Biases

* feat(wandb): make logging compatible with all scripts

* style(trainer.py): fix formatting

* [Trainer] Tweak wandb integration
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

818463ee

04 May, 2020 2 commits

allow an already created tensorboard SummaryWriter be passed to Trainer · 858b1d1e
jaymody authored Apr 27, 2020

858b1d1e

[EncoderDecoder Tests] Improve tests (#4046) · 8e67573a

Patrick von Platen authored May 04, 2020



* Hoist bert model tester for patric

* indent

* make tests work

* Update tests/test_modeling_bert.py
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
Co-authored-by: sshleifer <sshleifer@gmail.com>
Co-authored-by: Julien Chaumond <chaumond@gmail.com>

8e67573a

03 May, 2020 1 commit
- Add decoder specific error message for T5Stack.forward (#4128) · 6af3306a
  Lorenzo Ampil authored May 03, 2020
  
  6af3306a
02 May, 2020 11 commits
- Fix #2941 (#4109) · 1cdd2ad2
  Zhiyu Lin authored May 02, 2020
```
* Fix of issue #2941

Reshaped score array to avoid `numpy` ValueError.

* Update src/transformers/pipelines.py

* Update src/transformers/pipelines.py
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
```
  1cdd2ad2
- distilroberta-base-finetuned-sentiment (#4115) · 5f4f6b65
  Manuel Romero authored May 02, 2020
```
* Create model card

Create Model card for distilroberta-base-finetuned-sentiment

* Update model_cards/mrm8488/distilroberta-base-finetuned-sentiment/README.md

* Update model_cards/mrm8488/distilroberta-base-finetuned-sentiment/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
```
  5f4f6b65
- model card for surajp/albert-base-sanskrit (#4114) · 7da051f1
  Suraj Parmar authored May 02, 2020
```
* Create README.md

* Update model_cards/surajp/albert-base-sanskrit/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
```
  7da051f1
- Create README.md (#4112) · 14911e2e
  Zhen Wang authored May 02, 2020
  
  14911e2e
- Added huseinzol05/gpt2-345M-bahasa-cased (#4102) · 9e97c875
  HUSEIN ZOLKEPLI authored May 02, 2020
  
  9e97c875
- Update run_pl_glue.py (#4117) · 4c5bd921
  William Falcon authored May 02, 2020
  
  4c5bd921
- Update run_pl_ner.py (#4118) · 5282b31d
  William Falcon authored May 02, 2020
  
  5282b31d
- NER: parse args from .args file or JSON (#4110) · 1e616c0a
  Stefan Schweter authored May 02, 2020
```
* ner: parse args from .args file or JSON

* examples: mention json-based configuration file support for run_ner script
```
  1e616c0a
- Update README.md · abb1fa3f
  Patrick von Platen authored May 02, 2020
  
  abb1fa3f
- Update Reformer ReadME · 0ccbfd28
  Patrick von Platen authored May 02, 2020
  
  0ccbfd28
- [Reformer] Move model card to google model (#4113) · 2d8340a9
  Patrick von Platen authored May 02, 2020
```
* correct model card

* remove model card from patrick von platen
```
  2d8340a9
01 May, 2020 16 commits
- GePpeTto 🇮🇹: Fixpath to model card · d713cfc5
  Julien Chaumond authored May 01, 2020
  
  d713cfc5
- GePpeTto model 🇮🇹 (#4099) · f3d44301
  Lorenzo De Mattei authored May 01, 2020
```
* Create GePpeTto.md

* Update model_cards/LorenzoDeMattei/GePpeTto.md

* Update model_cards/LorenzoDeMattei/GePpeTto.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
```
  f3d44301
- Configs: saner num_labels in configs. (#3967) · 27d55125
  Julien Chaumond authored May 01, 2020
  
  27d55125
- docs: add xlm-roberta section to multi-lingual section (#4101) · e80be7f1
  Stefan Schweter authored May 01, 2020
  
  e80be7f1
- [testing] add timeout_decorator (#3543) · 18db92dd
  Sam Shleifer authored May 01, 2020
  
  18db92dd
- Merge pull request #3934 from huggingface/examples_args_from_files · b8686174
  Julien Chaumond authored Apr 30, 2020
```
[qol] example scripts: parse args from .args file or JSON
```
  b8686174
- [tests] Light cleanup of tempfile in tests/ · f39217a5
  Julien Chaumond authored Apr 23, 2020
  
  f39217a5
- [ci] Load pretrained models into the default (long-lived) cache · f54dc3f4
  Julien Chaumond authored Apr 23, 2020
```
There's an inconsistency right now where:
- we load some models into CACHE_DIR
- and some models in the default cache
- and often, in both for the same models

When running the RUN_SLOW tests, this takes a lot of disk space, time, and bandwidth.

I'd rather always use the default cache
```
  f54dc3f4
- Model Card: gaochangkuan README.md (#4033) · 6b410bed
  Scottish_Fold007 authored May 01, 2020
```
* Create README.md

* Update README.md

* tweak
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
```
  6b410bed
- added gpt2 117m bahasa readme · 8829ace4
  husein zolkepli authored Apr 30, 2020
```
(cherry picked from commit a4a673a1d0bec0bf4085eef021acb788ca1f5eb5)
```
  8829ace4
- create model_card camembert-base-wikipedia-4gb · 1851a64b
  Benjamin Muller authored Apr 29, 2020
  
  1851a64b
- Create README.md · 443e5e34
  Benjamin Muller authored Apr 29, 2020
  
  443e5e34
- Create model_card camembert-base-ccnet-4gb · 60e1556a
  Benjamin Muller authored Apr 29, 2020
  
  60e1556a
- Create README.md · fa9365ec
  Benjamin Muller authored Apr 29, 2020
  
  fa9365ec
- Create README.md · afe002b0
  Benjamin Muller authored Apr 29, 2020
  
  afe002b0
- Continue training args and tqdm in notebooks (#3939) · 8b5e5ebc
  Suraj Parmar authored May 01, 2020
```
* Continue training args

* Continue training args

* added explaination

* added explaination

* added explaination

* Fixed tqdm auto

* Update src/transformers/training_args.py
Co-Authored-By: Julien Chaumond <chaumond@gmail.com>

* Update src/transformers/training_args.py

* Update src/transformers/training_args.py
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
```
  8b5e5ebc