src/transformers/tokenization_utils_base.py · 7a22a02a7032c6fcecaad47363d84f98e239da79 · chenpangpang / transformers

[tokenizer.prepare_seq2seq_batch] change deprecation to be easily actionable (#12669) · 7a22a02a

Stas Bekman authored Jul 13, 2021



* change deprecation to be easily actionable

* Update src/transformers/tokenization_utils_base.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* rework as suggested

* one warning together

* fix format
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

7a22a02a

tokenization_utils_base.py 157 KB

Replace tokenization_utils_base.py