docs/source/en/main_classes/tokenizer.md · 147f774671c72ab24d17547030bb1f2803925d3b · chenpangpang / transformers · GitLab

Find file Blame History Permalink

[`PretrainedTokenizer`] add some of the most important functions to the doc (#27313) · 147f7746
Arthur authored Nov 06, 2023

147f7746

tokenizer.md 4.1 KB