tests/tokenization/test_tokenization_utils.py · 29c10a41d04f855c433a6cde7797b325651417d2 · chenpangpang / transformers

Lysandre Debut authored Feb 23, 2022



* Per-folder tests reorganization
Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Stas Bekman <stas@stason.org>

29c10a41

test_tokenization_utils.py 12.7 KB