tests/test_tokenization_common.py · ad28ca291bf851b48d7f2d4becf96ca90c98f8f1 · chenpangpang / transformers · GitLab

Find file Blame History Permalink

Fix properties of unset special tokens in non verbose mode (#17797) · 3eed5530
Guillaume Klein authored Jun 23, 2022
```
Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com>
```
3eed5530

test_tokenization_common.py 201 KB