Merge pull request #1 from huggingface/master

merege from original repo

Merge pull request #1 from huggingface/master
merege from original repo
7424b284 · ziliwang · GitHub · 6060b2f8 · 364920e2 · 7424b284
Unverified Commit 7424b284 authored Sep 11, 2019 by ziliwang Committed by GitHub Sep 11, 2019
8 changed files
--- a/pytorch_transformers/tokenization_gpt2.py
+++ b/pytorch_transformers/tokenization_gpt2.py
--- a/pytorch_transformers/tokenization_roberta.py
+++ b/pytorch_transformers/tokenization_roberta.py
--- a/pytorch_transformers/tokenization_transfo_xl.py
+++ b/pytorch_transformers/tokenization_transfo_xl.py
--- a/pytorch_transformers/tokenization_utils.py
+++ b/pytorch_transformers/tokenization_utils.py
--- a/pytorch_transformers/tokenization_xlm.py
+++ b/pytorch_transformers/tokenization_xlm.py
--- a/pytorch_transformers/tokenization_xlnet.py
+++ b/pytorch_transformers/tokenization_xlnet.py
--- a/requirements.txt
+++ b/requirements.txt
--- a/setup.py
+++ b/setup.py