Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Repository
"vscode:/vscode.git/clone" did not exist on "80c97e6a78b6f1ead85d04c40badaa1014d8a24d"
f3d18c71ece3323e5f3a5642074493b3f7bd0b36
Switch branch/tag
transformers
pytorch_transformers
tokenization_utils.py
Find file
Blame
History
Permalink
Merge pull request #1152 from epwalsh/fix-special-tokens
· f3d18c71
Thomas Wolf
authored
Aug 30, 2019
fix adding special tokens
f3d18c71
tokenization_utils.py
38.8 KB
Edit
Web IDE
Replace tokenization_utils.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace tokenization_utils.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
