"docs/source/model_doc/deit.rst" did not exist on "cb251ba619a471afa3c2ade481c7b8027d4b123f"
Unverified Commit 8f840edd authored by Arthur's avatar Arthur Committed by GitHub
Browse files

[`Whisper`] Nit converting the tokenizer (#27349)

* `nospeech` instead of `nocaption` for the no speech token

* oups
parent cc9f27bb
......@@ -235,7 +235,7 @@ def convert_tiktoken_to_hf(
"<|transcribe|>",
"<|startoflm|>",
"<|startofprev|>",
"<|nocaptions|>",
"<|nospeech|>",
"<|notimestamps|>",
]
# these are special tokens, not normalized
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment