Skip to content

GitLab

Unverified Commit 590be773 authored by amyeroberts's avatar amyeroberts Committed by GitHub
Browse files

[`SigLIP`] Only import tokenizer if sentencepiece available (#28636) 

Only import class if sp available
parent a35ea570
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/auto/tokenization_auto.py
View file @ 590be773
...@@ -379,7 +379,7 @@ else: ...@@ -379,7 +379,7 @@ else:
"SeamlessM4TTokenizerFast" if is_tokenizers_available() else None, "SeamlessM4TTokenizerFast" if is_tokenizers_available() else None,
), ),
), ),
("siglip", ("SiglipTokenizer", None)), ("siglip", ("SiglipTokenizer" if is_sentencepiece_available() else None, None)),
("speech_to_text", ("Speech2TextTokenizer" if is_sentencepiece_available() else None, None)), ("speech_to_text", ("Speech2TextTokenizer" if is_sentencepiece_available() else None, None)),
("speech_to_text_2", ("Speech2Text2Tokenizer", None)), ("speech_to_text_2", ("Speech2Text2Tokenizer", None)),
("speecht5", ("SpeechT5Tokenizer" if is_sentencepiece_available() else None, None)), ("speecht5", ("SpeechT5Tokenizer" if is_sentencepiece_available() else None, None)),
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment