tests/test_tokenization_auto.py · 3d587c53432c7c392aa08f582015c846ca076540 · chenpangpang / transformers · GitLab

Find file Blame History Permalink

[AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668) · 8e908c8c
Patrick von Platen authored Sep 22, 2021
```
* up

* up
```
8e908c8c

test_tokenization_auto.py 10.1 KB