"tests/phobert/test_tokenization_phobert.py" did not exist on "18a8a15f78a10ac6bf272bc762232b3f16df30e2"
-
Nicolas Patry authored
* Fixing OPT fast tokenizer option. * Remove dependency on `pt`. * Move it to GPT2 tokenization tests. * Added a few tests.
68bb33d7
