Commits · 206c35e9a42aaad03b9d686cb3a6cd9104b6f1dd · chenpangpang / transformers

30 Aug, 2019 27 commits
- fix distilbert in auto tokenizer · bfe93a5a
  thomwolf authored Aug 30, 2019
  
  bfe93a5a
- clean up and simplify hubconf · 256086bc
  thomwolf authored Aug 30, 2019
  
  256086bc
- fix distilbert tokenizer · 80aa87d9
  thomwolf authored Aug 30, 2019
  
  80aa87d9
- add distilbert tokenizer · 455a4c84
  thomwolf authored Aug 30, 2019
  
  455a4c84
- Added DistilBERT models to all other AutoModels. · dec8f4d6
  LysandreJik authored Aug 30, 2019
  
  dec8f4d6
- updating docstring for AutoModel · f35f6122
  thomwolf authored Aug 27, 2019
  
  f35f6122
- Tests for added AutoModels · 25e83894
  LysandreJik authored Aug 26, 2019
  
  25e83894
- Added multiple AutoModel classes: AutoModelWithLMHead,... · dc43215c
  LysandreJik authored Aug 26, 2019
```
Added multiple AutoModel classes: AutoModelWithLMHead, AutoModelForQuestionAnswering and AutoModelForSequenceClassification
```
  dc43215c
- fix tokenizers serialization · 7044ed6b
  thomwolf authored Aug 30, 2019
  
  7044ed6b
- added test and debug tokenizer configuration serialization · 69da972a
  thomwolf authored Aug 30, 2019
  
  69da972a
- saving and reloading tokenizer configurations · 88111de0
  thomwolf authored Aug 30, 2019
  
  88111de0
- adding xlm 17 and 100 models and config on aws · 3871b8a1
  thomwolf authored Aug 30, 2019
  
  3871b8a1
- adding 17 and 100 xlm models · 8678ff8d
  thomwolf authored Aug 30, 2019
  
  8678ff8d
- Added option to setup pretrained tokenizer arguments · 82462c5c
  thomwolf authored Aug 30, 2019
  
  82462c5c
- update tokenizers to use self.XX_token_id instead of converting self.XX_token · f8aace6b
  thomwolf authored Aug 30, 2019
  
  f8aace6b
- more doc on special tokens · 8faf2e08
  thomwolf authored Aug 30, 2019
  
  8faf2e08
- python2 doesn't spark joy · ce5ef4b3
  thomwolf authored Aug 30, 2019
  
  ce5ef4b3
- clean up all byte-level bpe tests · 5dd7b677
  thomwolf authored Aug 30, 2019
  
  5dd7b677
- fix for python2 · ca1a00a3
  thomwolf authored Aug 30, 2019
  
  ca1a00a3
- update roberta docstring as well · 4e6a3172
  thomwolf authored Aug 30, 2019
  
  4e6a3172
- update GPT2 docstring · fd10d79b
  thomwolf authored Aug 30, 2019
  
  fd10d79b
- fix GPT-2 and RoBERTa tests to be clean now · abe734ca
  thomwolf authored Aug 30, 2019
  
  abe734ca
- fix GPT2DoubleHeadModel docstring · 0f5a7994
  thomwolf authored Aug 30, 2019
  
  0f5a7994
- adding shortcut to the ids of all the special tokens · d51f72d5
  thomwolf authored Aug 30, 2019
  
  d51f72d5
- fix Roberta tokenizer __init__ · 50e6daf8
  thomwolf authored Aug 30, 2019
  
  50e6daf8
- Fix GPT2 and RoBERTa tokenizer to beging with a space - update Roberta tokenizer · 0517e7a1
  thomwolf authored Aug 30, 2019
  
  0517e7a1
- fix: hard coding for max number · 6060b2f8
  ziliwang authored Aug 30, 2019
```
fp16 max number is 65504, the original 1e30 will cause Nan in fp16
```
  6060b2f8
29 Aug, 2019 1 commit
- fix adding special tokens · 07e21307
  epwalsh authored Aug 29, 2019
  
  07e21307
28 Aug, 2019 12 commits
- fix #1131 · 0a74c88a
  thomwolf authored Aug 28, 2019
  
  0a74c88a
- distilbert: fix number of hidden_size · ed2ab1c2
  Stefan Schweter authored Aug 28, 2019
  
  ed2ab1c2
- update again · e7706f51
  thomwolf authored Aug 28, 2019
  
  e7706f51
- update credits · b5eb283a
  thomwolf authored Aug 28, 2019
  
  b5eb283a
- Removed typings for Python 2 · f753d4e3
  LysandreJik authored Aug 28, 2019
  
  f753d4e3
- Updated article link · 75bc2a03
  LysandreJik authored Aug 28, 2019
  
  75bc2a03
- Documentation additions · 1dc43e56
  LysandreJik authored Aug 28, 2019
  
  1dc43e56
- dilbert -> distilbert · 912a377e
  thomwolf authored Aug 28, 2019
  
  912a377e
- fixing model to add torchscript, embedding resizing, head pruning and masking + tests · c9bce181
  thomwolf authored Aug 28, 2019
  
  c9bce181
- add dilbert tokenizer and tests · 62df4ba5
  thomwolf authored Aug 28, 2019
  
  62df4ba5
- fix typo · a5fe1668
  VictorSanh authored Aug 28, 2019
  
  a5fe1668
- add DilBert model for squad · 19b7c9b0
  VictorSanh authored Aug 28, 2019
  
  19b7c9b0