Skip to content

GitLab

Commit 80aa87d9 authored by thomwolf's avatar thomwolf
Browse files

fix distilbert tokenizer

parent 455a4c84
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
pytorch_transformers/tokenization_auto.py
View file @ 80aa87d9
......@@ -25,7 +25,7 @@ from .tokenization_transfo_xl import TransfoXLTokenizer
from .tokenization_xlnet import XLNetTokenizer
from .tokenization_xlm import XLMTokenizer
from .tokenization_roberta import RobertaTokenizer
from.tokenization_distilbert import DistilBertTokenizer
from .tokenization_distilbert import DistilBertTokenizer
logger = logging.getLogger(__name__)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment