Commits · cdcb206e1065a21dd2357c3d3255c6d8767d11b6 · chenpangpang / transformers

13 Feb, 2019 1 commit
- OpenAI GPT Tokenizer can fallback on using BERT BasicTokenizer · c6bea084
  thomwolf authored Feb 13, 2019
  
  c6bea084
11 Feb, 2019 1 commit
- added tests for OpenAI GPT and Transformer-XL tokenizers · b514a60c
  thomwolf authored Feb 11, 2019
  
  b514a60c
07 Feb, 2019 1 commit
- docstrings · f99f2fb6
  thomwolf authored Feb 07, 2019
  
  f99f2fb6
05 Feb, 2019 1 commit
- python 2 compatibility · 448937c0
  thomwolf authored Feb 06, 2019
  
  448937c0
04 Feb, 2019 4 commits
- clean up tokenization spaces · 6179f537
  thomwolf authored Feb 04, 2019
  
  6179f537
- strip decoded outputs · 850da1cc
  thomwolf authored Feb 04, 2019
  
  850da1cc
- more options on special tokens · 01a3966b
  thomwolf authored Feb 04, 2019
  
  01a3966b
- logging · 05f96184
  thomwolf authored Feb 04, 2019
  
  05f96184
28 Jan, 2019 1 commit
- directly load from TF checkpoints + code cleanup · d77dd62f
  thomwolf authored Jan 28, 2019
  
  d77dd62f
08 Jan, 2019 2 commits
- added tests + fixed losses · 3cf12b23
  thomwolf authored Jan 08, 2019
  
  3cf12b23
- add OpenAI GPT · eed51c5b
  thomwolf authored Jan 08, 2019
  
  eed51c5b
07 Jan, 2019 1 commit
- adding OpenAI GPT · 93f563b8
  thomwolf authored Jan 07, 2019
  
  93f563b8