Commits · bdaba1897c14e0243d7fb58ddf5061957c70eea6 · chenpangpang / transformers

16 Apr, 2019 1 commit
- improving GPT2 tokenization and adding tests · 18a8a15f
  thomwolf authored Apr 16, 2019
  
  18a8a15f
15 Apr, 2019 3 commits
- fixing tests · e8568a3b
  thomwolf authored Apr 15, 2019
  
  e8568a3b
- added tokenizers serialization tests · 870b734b
  thomwolf authored Apr 15, 2019
  
  870b734b
- add serialization semantics to tokenizers - fix transfo-xl tokenizer · 3e65f255
  thomwolf authored Apr 15, 2019
  
  3e65f255
06 Mar, 2019 1 commit
- fix typo - logger info · 5c85fc39
  thomwolf authored Mar 06, 2019
  
  5c85fc39
05 Mar, 2019 1 commit
- Warn instead of raising in BERT and GPT-2 tokenizers as well, to allow for pre-caching of tokens · 4a49c225
  Catalin Voss authored Mar 05, 2019
  
  4a49c225
18 Feb, 2019 3 commits
- simple · ab7f5d29
  thomwolf authored Feb 18, 2019
  
  ab7f5d29
- clean up tokenization - fix python 2 tests · b450a7fa
  thomwolf authored Feb 18, 2019
  
  b450a7fa
- update readme · d44db114
  thomwolf authored Feb 18, 2019
  
  d44db114
17 Feb, 2019 1 commit
- adding gpt2 · ffd62382
  thomwolf authored Feb 17, 2019
  
  ffd62382