Commits · a7dafe2f41222469797f1a67232961d67bd2e519 · chenpangpang / transformers

"docs/vscode:/vscode.git/clone" did not exist on "3d39226a5110860a2435b0f4152699ae432bb543"

22 Nov, 2019 2 commits
- Padding strategy (left and right) rather than boolean flag · a7dafe2f
  LysandreJik authored Nov 21, 2019
  
  a7dafe2f
- `encode` and `encode_plus` handle attention masks and padding · 9f374c82
  LysandreJik authored Nov 22, 2019
  
  9f374c82
12 Nov, 2019 1 commit
- Fix special tokens addition in decoder · 74d0bcb6
  Lysandre authored Nov 12, 2019
  
  74d0bcb6
22 Oct, 2019 1 commit
- Remove · 7d709e55
  Lysandre authored Oct 22, 2019
  
  7d709e55
04 Oct, 2019 2 commits
- fixes · 78ef1a99
  thomwolf authored Oct 04, 2019
  
  78ef1a99
- update encode_plus - add truncation strategies · 6c1d0bc0
  thomwolf authored Oct 04, 2019
  
  6c1d0bc0
03 Oct, 2019 5 commits
- Update naming + remove f string in run_lm_finetuning example · aebd8323
  LysandreJik authored Oct 02, 2019
  
  aebd8323
- always_truncate by default · 651bfb7a
  LysandreJik authored Sep 30, 2019
  
  651bfb7a
- Supports already existing special tokens · cc412edd
  LysandreJik authored Sep 30, 2019
  
  cc412edd
- Sequence IDS · 2f259b22
  LysandreJik authored Sep 30, 2019
  
  2f259b22
- Always truncate argument in the encode method · 7c789c33
  LysandreJik authored Sep 30, 2019
  
  7c789c33
26 Sep, 2019 1 commit
- [BIG] pytorch-transformers => transformers · 31c23bd5
  thomwolf authored Sep 26, 2019
  
  31c23bd5
24 Sep, 2019 4 commits
- various updates · a6981076
  thomwolf authored Sep 24, 2019
  
  a6981076
- `output_token_type` -> `token_type_ids` · c832f43a
  LysandreJik authored Sep 24, 2019
  
  c832f43a
- Updated tests · 0ea82b24
  LysandreJik authored Sep 24, 2019
  
  0ea82b24
- Updated DistilBERT · 9d44236f
  LysandreJik authored Sep 24, 2019
  
  9d44236f
19 Sep, 2019 9 commits
- Tokenizer accepts token list as well as string · 3df208c9
  LysandreJik authored Sep 19, 2019
  
  3df208c9
- prepare_for_model and prepare_pair_for_model methods. Added an option to... · 66ea76b8
  LysandreJik authored Sep 19, 2019
```
prepare_for_model and prepare_pair_for_model methods. Added an option to select which sequence will be truncated.
```
  66ea76b8
- Stride + tests + small fixes · baa74326
  LysandreJik authored Sep 19, 2019
  
  baa74326
- Mask computing in standalone method. Tests. · c10c7d59
  LysandreJik authored Sep 19, 2019
  
  c10c7d59
- Sentence -> Sequence. Removed output_mask from the special token addition methods. · bf503158
  LysandreJik authored Sep 19, 2019
  
  bf503158
- encode + encode_plus tests modified · 6393261e
  LysandreJik authored Sep 19, 2019
  
  6393261e
- Max encoding length + corresponding tests · af23b626
  LysandreJik authored Sep 11, 2019
  
  af23b626
- Number of added tokens calculator · d572d702
  LysandreJik authored Sep 11, 2019
  
  d572d702
- Added binary masking tests · c3df2136
  LysandreJik authored Sep 02, 2019
  
  c3df2136
05 Sep, 2019 1 commit
- adding test for common properties and cleaning up a bit base class · 5c6cac10
  thomwolf authored Sep 05, 2019
  
  5c6cac10
02 Sep, 2019 1 commit
- fixing #1133 · fede4ef4
  thomwolf authored Sep 02, 2019
  
  fede4ef4
30 Aug, 2019 4 commits
- fix tokenizers serialization · 7044ed6b
  thomwolf authored Aug 30, 2019
  
  7044ed6b
- added test and debug tokenizer configuration serialization · 69da972a
  thomwolf authored Aug 30, 2019
  
  69da972a
- fix GPT-2 and RoBERTa tests to be clean now · abe734ca
  thomwolf authored Aug 30, 2019
  
  abe734ca
- adding shortcut to the ids of all the special tokens · d51f72d5
  thomwolf authored Aug 30, 2019
  
  d51f72d5
09 Aug, 2019 1 commit
- Tokenization encode/decode class-based sequence handling · 14e970c2
  LysandreJik authored Aug 09, 2019
  
  14e970c2
08 Aug, 2019 1 commit
- Updated test architecture · fbd746bd
  LysandreJik authored Aug 08, 2019
  
  fbd746bd
05 Aug, 2019 1 commit
- cleaning up tokenizer tests structure (at last) - last remaining ppb refs · 328afb70
  thomwolf authored Aug 05, 2019
  
  328afb70
16 Jul, 2019 1 commit
- update readme and pretrained model weight files · 1849aa7d
  thomwolf authored Jul 16, 2019
  
  1849aa7d
15 Jul, 2019 1 commit
- update tokenizer - update squad example for xlnet · 15d8b126
  thomwolf authored Jul 15, 2019
  
  15d8b126
09 Jul, 2019 3 commits
- updating test · d743f2f3
  thomwolf authored Jul 09, 2019
  
  d743f2f3
- fix python 2 tests · c079d7dd
  thomwolf authored Jul 09, 2019
  
  c079d7dd
- unified tokenizer api and serialization + tests · b1978698
  thomwolf authored Jul 09, 2019
  
  b1978698
05 Jul, 2019 1 commit
- fix python2 tests · 6dacc79d
  thomwolf authored Jul 05, 2019
  
  6dacc79d