Merge branch 'huggingface/master'

86a63070 · erenup · b5d73976 · 82f6abd9 · 86a63070 · 86a63070
Commit 86a63070 authored Oct 21, 2019 by erenup
Expand all Hide whitespace changes
Inline Side-by-side

Showing with 75 additions and 23 deletions

transformers/tokenization_xlm.py transformers/tokenization_xlm.py +39 -12

transformers/tokenization_xlnet.py transformers/tokenization_xlnet.py +36 -11

No files found.
--- a/transformers/tokenization_xlm.py
+++ b/transformers/tokenization_xlm.py
--- a/transformers/tokenization_xlnet.py
+++ b/transformers/tokenization_xlnet.py