Commits · 629b22adcfe340c4e3babac83654da2fbd1bbf89 · chenpangpang / transformers

01 Jan, 2020 1 commit
- [run_lm_finetuning] mask_tokens: document types · 629b22ad
  Julien Chaumond authored Jan 01, 2020
  
  629b22ad
29 Dec, 2019 2 commits
- [debug] Debug Heisenbug, the old school way. · 594ca6de
  Julien Chaumond authored Dec 28, 2019
  
  594ca6de
- [http] Tweak http user-agent (#2353) · 0df4e62d
  Julien Chaumond authored Dec 29, 2019
  
  0df4e62d
28 Dec, 2019 6 commits
- Merge pull request #2352 from huggingface/cli_tweaks · f75bf05c
  Thomas Wolf authored Dec 28, 2019
```
Cli tweaks
```
  f75bf05c
- Typo · 0d467fd6
  Julien Chaumond authored Dec 27, 2019
  
  0d467fd6
- [cli] upload: max number of files at the same time · d8293e84
  Julien Chaumond authored Dec 27, 2019
  
  d8293e84
- Kill __main__ · 4d6c93e9
  Julien Chaumond authored Dec 27, 2019
  
  4d6c93e9
- [cli] Update doc · 9b2badf3
  Julien Chaumond authored Dec 27, 2019
  
  9b2badf3
- [cli] Add ability to delete remote object · f78ebc22
  Julien Chaumond authored Dec 27, 2019
  
  f78ebc22
27 Dec, 2019 7 commits
- Hotfix tokenizers version for sdist installs · bfe870be
  Anthony MOI authored Dec 27, 2019
  
  bfe870be
- Merge pull request #2286 from adelevie/patch-2 · 74ea4328
  Thomas Wolf authored Dec 27, 2019
```
Typo in tokenization_utils.py
```
  74ea4328
- Merge pull request #2292 from patrickvonplaten/add_cached_past_for_language_generation · 492bea9a
  Thomas Wolf authored Dec 27, 2019
```
Add cached past for language generation
```
  492bea9a
- Merge pull request #2290 from patrickvonplaten/fix_typo_in_doc_for_language_generation · e213900f
  Thomas Wolf authored Dec 27, 2019
```
duplicated line for repeating_words_penalty_for_language_generation
```
  e213900f
- Merge pull request #2211 from huggingface/fast-tokenizers · 9f5f6464
  Thomas Wolf authored Dec 27, 2019
```
Fast tokenizers
```
  9f5f6464
- Auto-format (fixes previous commit). · 9024b199
  Aymeric Augustin authored Dec 27, 2019
  
  9024b199
- Quote square brackets in shell commands. · 3233b58a
  Aymeric Augustin authored Dec 27, 2019
```
This ensures compatibility with zsh.

Fix #2316.
```
  3233b58a
26 Dec, 2019 7 commits
- Better added_tokens handling · e6ec24fa
  Anthony MOI authored Dec 26, 2019
  
  e6ec24fa
- Code style update · 599db139
  Anthony MOI authored Dec 26, 2019
  
  599db139
- Handle unk_token · 835b76a4
  Anthony MOI authored Dec 26, 2019
```
As we discussed, this is handled here directly 
cc @thomwolf
```
  835b76a4
- FastPreTrainedTokenizer => PreTrainedTokenizerFast · 7ead04ce
  Anthony MOI authored Dec 26, 2019
  
  7ead04ce
- Update for changes in tokenizers API · 1f82a5d9
  Anthony MOI authored Dec 26, 2019
  
  1f82a5d9
- Merge pull request #2324 from kashif/patch-1 · 8c67b529
  Thomas Wolf authored Dec 26, 2019
```
Typo in serving.py
```
  8c67b529
- Typo in serving.py · 7211541a
  Kashif Rasul authored Dec 26, 2019
  
  7211541a
25 Dec, 2019 17 commits
- improve comments for examples · 0f6017be
  patrickvonplaten authored Dec 26, 2019
  
  0f6017be
- add example for ctrl text generation in docs · 87c8fca9
  patrickvonplaten authored Dec 25, 2019
  
  87c8fca9
- merge conflicts - renamed to previous_token singular · 88def24c
  patrickvonplaten authored Dec 26, 2019
  
  88def24c
- duplicated line for repeating_words_penalty_for_language_generation · 822f725a
  patrickvonplaten authored Dec 23, 2019
  
  822f725a
- adapt style to predefined style layout · fc84bd52
  patrickvonplaten authored Dec 25, 2019
  
  fc84bd52
- add prepare inputs for transfo_xl and xlnet · deff792b
  patrickvonplaten authored Dec 25, 2019
  
  deff792b
- add easy tensor shape match test · 9398058e
  patrickvonplaten authored Dec 25, 2019
  
  9398058e
- add past re-ordering for beam search · 90cda45e
  patrickvonplaten authored Dec 25, 2019
  
  90cda45e
- check for self.config.mem_len instead of self.mem_len in _do_output_past · 6bca56fd
  patrickvonplaten authored Dec 24, 2019
  
  6bca56fd
- make if statements cleaner for prepare_inputs_for_generation · 365ccd0a
  patrickvonplaten authored Dec 23, 2019
  
  365ccd0a
- better naming for if statement · d039c679
  patrickvonplaten authored Dec 23, 2019
  
  d039c679
- changed do_output_past function to check for self.config.output_past instead of self.output_past · 7e0c5c73
  patrickvonplaten authored Dec 23, 2019
  
  7e0c5c73
- rename comments · eeaa402c
  patrickvonplaten authored Dec 23, 2019
  
  eeaa402c
- remove ipdb debugging statements · 7bb42712
  patrickvonplaten authored Dec 23, 2019
  
  7bb42712
- add and improve comments · 267587c2
  patrickvonplaten authored Dec 23, 2019
  
  267587c2
- add past hidden key states for more efficient language generation & add... · d891fd0a
  patrickvonplaten authored Dec 23, 2019
```
add past hidden key states for more efficient language generation & add prepare_inputs for gpt2 and ctrl model
```
  d891fd0a
- Merge pull request #2303 from patrickvonplaten/fix_error_with_repetition_penalty · aeef4823
  Thomas Wolf authored Dec 25, 2019
```
fix repetition penalty error in modeling_utils.py
```
  aeef4823