Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Repository
9f5f646442ce56ebd505f2c164949f2930bb1fbe
Switch branch/tag
transformers
tests
test_tokenization_common.py
Find file
Blame
History
Permalink
Merge pull request #2211 from huggingface/fast-tokenizers
· 9f5f6464
Thomas Wolf
authored
Dec 27, 2019
Fast tokenizers
9f5f6464
test_tokenization_common.py
20.9 KB
Edit
Web IDE
Replace test_tokenization_common.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace test_tokenization_common.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
