Skip to content

GitLab

Unverified Commit 3587769c authored by Sanchit Gandhi's avatar Sanchit Gandhi Committed by GitHub
Browse files

[VITS] Only trigger tokenizer warning for uroman (#25915)

parent 1fa2d89a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/vits/tokenization_vits.py
View file @ 3587769c
...@@ -184,7 +184,7 @@ class VitsTokenizer(PreTrainedTokenizer): ...@@ -184,7 +184,7 @@ class VitsTokenizer(PreTrainedTokenizer):
filtered_text = self._preprocess_char(text) filtered_text = self._preprocess_char(text)
if has_non_roman_characters(filtered_text): if has_non_roman_characters(filtered_text) and self.is_uroman:
logger.warning( logger.warning(
"Text to the tokenizer contains non-Roman characters. Ensure the `uroman` Romanizer is " "Text to the tokenizer contains non-Roman characters. Ensure the `uroman` Romanizer is "
"applied to the text prior to passing it to the tokenizer. See " "applied to the text prior to passing it to the tokenizer. See "
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment