Skip to content

GitLab

Unverified Commit 134a8e21 authored by Patrick von Platen's avatar Patrick von Platen Committed by GitHub
Browse files

[CLIPTokenizer] Improve warning (#20458)

parent de53e4bf
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/clip/tokenization_clip.py
View file @ 134a8e21
...@@ -315,7 +315,7 @@ class CLIPTokenizer(PreTrainedTokenizer): ...@@ -315,7 +315,7 @@ class CLIPTokenizer(PreTrainedTokenizer):
self.fix_text = ftfy.fix_text self.fix_text = ftfy.fix_text
except ImportError: except ImportError:
logger.warning("ftfy or spacy is not installed using BERT BasicTokenizer instead of ftfy.") logger.info("ftfy or spacy is not installed using custom BasicTokenizer instead of ftfy.")
self.nlp = BasicTokenizer(do_lower_case=True) self.nlp = BasicTokenizer(do_lower_case=True)
self.fix_text = None self.fix_text = None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment