Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Repository
"vscode:/vscode.git/clone" did not exist on "3224c0c13fc9ef351c7a1a6e9f1401b3ce13859a"
c52b515e948fc12ff58ad773a0385860d0162f61
Switch branch/tag
transformers
src
transformers
tokenization_utils_base.py
Find file
Blame
History
Permalink
Fix a typo in tokenizer documentation (#28118)
· c52b515e
Mike Salvatore
authored
Dec 18, 2023
c52b515e
tokenization_utils_base.py
192 KB
Edit
Web IDE
Replace tokenization_utils_base.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace tokenization_utils_base.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.