tests/test_tokenization_t5.py · 624495706c42932ca226419bfe980abdfe644e14 · chenpangpang / transformers · GitLab

"macapp/src/index.ts" did not exist on "a9cc270b4da9bac2b2ffbc05c809b49e56649816"

Find file Blame History Permalink

T5Tokenizer adds EOS token if not already added (#5866) · 62449570
Sam Shleifer authored Aug 25, 2020
```
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
```
62449570

test_tokenization_t5.py 7.1 KB