tests/models/herbert/test_tokenization_herbert.py · 8e589c83b607ede06d2c935cab2f2ead7bac17c4 · chenpangpang / transformers

[tests] add the missing `require_sacremoses` decorator (#29504) · 8e589c83

Fanli Lin authored Mar 08, 2024



* add sacremoses check

* fix style

* for FlaubertTokenizer

* HerbertTokenizer fix

* add typeHint

* Update src/transformers/testing_utils.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* make less skipped

* make quality

* remove import

---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

8e589c83

test_tokenization_herbert.py 4.83 KB

Replace test_tokenization_herbert.py