Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
8f840edd
Unverified
Commit
8f840edd
authored
Nov 07, 2023
by
Arthur
Committed by
GitHub
Nov 07, 2023
Browse files
[`Whisper`] Nit converting the tokenizer (#27349)
* `nospeech` instead of `nocaption` for the no speech token * oups
parent
cc9f27bb
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
src/transformers/models/whisper/convert_openai_to_hf.py
src/transformers/models/whisper/convert_openai_to_hf.py
+1
-1
No files found.
src/transformers/models/whisper/convert_openai_to_hf.py
View file @
8f840edd
...
...
@@ -235,7 +235,7 @@ def convert_tiktoken_to_hf(
"<|transcribe|>"
,
"<|startoflm|>"
,
"<|startofprev|>"
,
"<|no
captions
|>"
,
"<|no
speech
|>"
,
"<|notimestamps|>"
,
]
# these are special tokens, not normalized
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment