tests/test_tokenization_common.py · fb7cbe236b64c9a039222949d444b6632b1121c9 · chenpangpang / transformers · GitLab

Find file Blame History Permalink

Fix incorrect model<->tokenizer mapping in tokenization testing (#19872) · f9257843
Yih-Dar authored Oct 25, 2022
```
* Fix model-tokenizer mapping
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
f9257843

test_tokenization_common.py 205 KB