tests/test_tokenization_albert.py · 1809de5165804666ba6c6a02a9d177f6683869cc · chenpangpang / transformers · GitLab

Find file Blame History Permalink

ALBERT Tokenizer integration test (#9943) · 1809de51
Lysandre Debut authored Feb 02, 2021
```
* ALBERT Tokenizer integration test

* Batching

* Style
```
1809de51

test_tokenization_albert.py 7.38 KB