tests/test_tokenization_bert_japanese.py · 00204f2b4cf52eb9541841c79949bd8f29728b47 · chenpangpang / transformers · GitLab

Find file Blame History Permalink

Replace CommonTestCases for tokenizers with a mixin. · 00204f2b
Aymeric Augustin authored Dec 22, 2019
```
This is the same change as for (TF)CommonTestCases for modeling.
```
00204f2b

test_tokenization_bert_japanese.py 7.76 KB