src/transformers/tokenization_transfo_xl.py · 6435b9f908e7361330db89e263a65b0a58060d11 · chenpangpang / transformers · GitLab

"src/vscode:/vscode.git/clone" did not exist on "294a0e66a36cd54c084107bc2561c1b25da93462"

Find file Blame History Permalink

Updating the TensorFlow models to work as expected with tokenizers v3.0.0 (#3684) · 6435b9f9
Lysandre Debut authored Apr 08, 2020
```
* Updating modeling tf files; adding tests

* Merge `encode_plus` and `batch_encode_plus`
```
6435b9f9

tokenization_transfo_xl.py 27.6 KB