tests/test_tokenization_pegasus.py · 3095ee9dab739f212a8753b5be4e1a72ba42e28e · chenpangpang / transformers

Tokenizers should be framework agnostic (#8599) · 3095ee9d

Lysandre Debut authored Nov 17, 2020



* Tokenizers should be framework agnostic

* Run the slow tests

* Not testing

* Fix documentation

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

3095ee9d

test_tokenization_pegasus.py 2.92 KB

Replace test_tokenization_pegasus.py