Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/diffusers.git" did not exist on "ece55227ffc60f7bb09442b390a02e45ac0438f8"
Commit 80aa87d9 authored by thomwolf's avatar thomwolf
Browse files

fix distilbert tokenizer

parent 455a4c84
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
pytorch_transformers/tokenization_auto.py
View file @ 80aa87d9
...@@ -25,7 +25,7 @@ from .tokenization_transfo_xl import TransfoXLTokenizer ...@@ -25,7 +25,7 @@ from .tokenization_transfo_xl import TransfoXLTokenizer
from .tokenization_xlnet import XLNetTokenizer from .tokenization_xlnet import XLNetTokenizer
from .tokenization_xlm import XLMTokenizer from .tokenization_xlm import XLMTokenizer
from .tokenization_roberta import RobertaTokenizer from .tokenization_roberta import RobertaTokenizer
from.tokenization_distilbert import DistilBertTokenizer from .tokenization_distilbert import DistilBertTokenizer
logger = logging.getLogger(__name__) logger = logging.getLogger(__name__)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment