Commits · e4022d96f76c650edfb037d748bc70175e6f2430 · chenpangpang / transformers

24 Sep, 2019 15 commits
- Merge pull request #1325 from huggingface/glue-included · e4022d96
  Thomas Wolf authored Sep 24, 2019
```
[Proposal] GLUE processors included in library
```
  e4022d96
- fix output_token_type in glue · 789ea720
  thomwolf authored Sep 24, 2019
  
  789ea720
- Merge branch 'glue-example' into glue-included · 1cbd566c
  thomwolf authored Sep 24, 2019
  
  1cbd566c
- py2 fix · 743e383d
  thomwolf authored Sep 24, 2019
  
  743e383d
- update data processors __init__ · 99a90e43
  thomwolf authored Sep 24, 2019
  
  99a90e43
- updated data processor and metrics · b5ec526f
  thomwolf authored Sep 24, 2019
  
  b5ec526f
- various updates · a6981076
  thomwolf authored Sep 24, 2019
  
  a6981076
- Relative imports · 0b82e3d0
  LysandreJik authored Sep 24, 2019
  
  0b82e3d0
- [Proposal] GLUE processors included in library · f09e5ece
  LysandreJik authored Sep 24, 2019
  
  f09e5ece
- Fixed DistilBERT tokenizer · 72402d1a
  LysandreJik authored Sep 24, 2019
  
  72402d1a
- create_mask_from_sequences -> create_token_type_ids_from_sequences · d340e232
  LysandreJik authored Sep 24, 2019
  
  d340e232
- `output_token_type` -> `token_type_ids` · c832f43a
  LysandreJik authored Sep 24, 2019
  
  c832f43a
- Updated the GLUE pre-processing method · 3927d775
  LysandreJik authored Sep 24, 2019
  
  3927d775
- Updated tests · 0ea82b24
  LysandreJik authored Sep 24, 2019
  
  0ea82b24
- Updated DistilBERT · 9d44236f
  LysandreJik authored Sep 24, 2019
  
  9d44236f
19 Sep, 2019 22 commits
- Python 2 compatibility · ab984a8b
  LysandreJik authored Sep 19, 2019
  
  ab984a8b
- Tokenizer accepts token list as well as string · 3df208c9
  LysandreJik authored Sep 19, 2019
  
  3df208c9
- prepare_for_model and prepare_pair_for_model methods. Added an option to... · 66ea76b8
  LysandreJik authored Sep 19, 2019
```
prepare_for_model and prepare_pair_for_model methods. Added an option to select which sequence will be truncated.
```
  66ea76b8
- GLUE updated with new methods · 60414f31
  LysandreJik authored Sep 19, 2019
  
  60414f31
- Stride + tests + small fixes · baa74326
  LysandreJik authored Sep 19, 2019
  
  baa74326
- Mask computing in standalone method. Tests. · c10c7d59
  LysandreJik authored Sep 19, 2019
  
  c10c7d59
- Sentence -> Sequence. Removed output_mask from the special token addition methods. · bf503158
  LysandreJik authored Sep 19, 2019
  
  bf503158
- Doc + remove artefacts · 8cba0572
  LysandreJik authored Sep 19, 2019
  
  8cba0572
- encode + encode_plus tests modified · 6393261e
  LysandreJik authored Sep 19, 2019
  
  6393261e
- Modified encode to return only lists. Added a more complete encode_plus method · dcc9bb32
  LysandreJik authored Sep 19, 2019
  
  dcc9bb32
- Max encoding length + corresponding tests · af23b626
  LysandreJik authored Sep 11, 2019
  
  af23b626
- Updated DistilBERT test to reflect the sequence encoding · c4d4f3ec
  LysandreJik authored Sep 11, 2019
  
  c4d4f3ec
- Number of added tokens calculator · d572d702
  LysandreJik authored Sep 11, 2019
  
  d572d702
- Added DistilBERT to run_squad script · de8e14b6
  LysandreJik authored Sep 11, 2019
  
  de8e14b6
- Added DistilBERT to `run_lm_finetuning` · 88368c2a
  LysandreJik authored Sep 06, 2019
  
  88368c2a
- Changed warning to be more explicit · 2d8ec5a6
  LysandreJik authored Sep 06, 2019
```
Co-authored by: julien_c <chaumond@gmail.com>
```
  2d8ec5a6
- Updated GLUE script to add DistilBERT. Cleaned up unused args in the utils file. · 75635072
  LysandreJik authored Sep 06, 2019
  
  75635072
- Distilbert sequence builder w/ mask · 92a9976e
  LysandreJik authored Sep 06, 2019
  
  92a9976e
- typo · 59057abe
  LysandreJik authored Sep 02, 2019
  
  59057abe
- Updated the GLUE data processor. Corrections to RoBERTa and XLNet. · bac332fe
  LysandreJik authored Sep 02, 2019
  
  bac332fe
- Added binary masking tests · c3df2136
  LysandreJik authored Sep 02, 2019
  
  c3df2136
- Tokenizers' encode function can output binary masks · e391d473
  LysandreJik authored Sep 02, 2019
  
  e391d473
18 Sep, 2019 3 commits
- Merge pull request #1004 from erenup/master · 0d1dad6d
  Thomas Wolf authored Sep 18, 2019
```
Refactoring old run_swag.py
```
  0d1dad6d
- fixed to find best dev acc · 8960988f
  erenup authored Sep 19, 2019
  
  8960988f
- Merge pull request #3 from erenup/run_multiple_choice_merge · b57bfb5f
  erenup authored Sep 18, 2019
```
Run multiple choice merge
```
  b57bfb5f