tests/test_tokenization_common.py · dfb00bf64415b15220bc0d4b7ab40318f195a2d4 · chenpangpang / transformers · GitLab

Find file Blame History Permalink

Expand dynamic supported objects to configs and tokenizers (#14296) · dfb00bf6
Sylvain Gugger authored Nov 08, 2021
```
* Dynamic configs

* Add config test

* Better tests

* Add tokenizer and test

* Add to from_config

* With save
```
dfb00bf6

test_tokenization_common.py 184 KB