Commits · e468192e2f0099faf3948551cd618eb2942cae2c · chenpangpang / transformers

09 Jul, 2019 1 commit
- unified tokenizer api and serialization + tests · b1978698
  thomwolf authored Jul 09, 2019
  
  b1978698
05 Jul, 2019 3 commits
- tokenization abstract class - tests for examples · 36bca545
  thomwolf authored Jul 05, 2019
  
  36bca545
- [BIG] name change · 0bab55d5
  thomwolf authored Jul 05, 2019
  
  0bab55d5
- standardizing tokenizers API and adding tests · e75c3f70
  thomwolf authored Jul 05, 2019
  
  e75c3f70
17 Jun, 2019 1 commit
- better error messages · 8415a38b
  thomwolf authored Jun 17, 2019
  
  8415a38b
15 Apr, 2019 3 commits
- tokenization updates · b3c6ee0a
  thomwolf authored Apr 15, 2019
  
  b3c6ee0a
- added tokenizers serialization tests · 870b734b
  thomwolf authored Apr 15, 2019
  
  870b734b
- add serialization semantics to tokenizers - fix transfo-xl tokenizer · 3e65f255
  thomwolf authored Apr 15, 2019
  
  3e65f255
06 Mar, 2019 1 commit
- fix typo - logger info · 5c85fc39
  thomwolf authored Mar 06, 2019
  
  5c85fc39
20 Feb, 2019 1 commit
- typo · 2fdab323
  Yongbo Wang authored Feb 20, 2019
  
  2fdab323
11 Feb, 2019 3 commits
- adapting transfo tokenizer to transposed inputs · e8fe6b71
  thomwolf authored Feb 11, 2019
  
  e8fe6b71
- transposing the inputs of Transformer-XL to have a unified interface · 884ca81d
  thomwolf authored Feb 11, 2019
  
  884ca81d
- added tests for OpenAI GPT and Transformer-XL tokenizers · b514a60c
  thomwolf authored Feb 11, 2019
  
  b514a60c
05 Feb, 2019 1 commit
- python 2 compatibility · 448937c0
  thomwolf authored Feb 06, 2019
  
  448937c0
16 Jan, 2019 1 commit
- fixing various parts of model conversion, loading and weights sharing · 8831c688
  thomwolf authored Jan 16, 2019
  
  8831c688
15 Jan, 2019 2 commits
- improved corpus and tokenization conversion - added evaluation script · a69ec2c7
  thomwolf authored Jan 15, 2019
  
  a69ec2c7
- adding Transformer XL · 3a9c8837
  thomwolf authored Jan 15, 2019
  
  3a9c8837