Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
841e87ef
"...runners/git@developer.sourcefind.cn:Wenxuan/LightX2V.git" did not exist on "3e67df1c040f57a7aa325cb2d0a4c2c47686604c"
Unverified
Commit
841e87ef
authored
Apr 09, 2024
by
Raushan Turganbay
Committed by
GitHub
Apr 09, 2024
Browse files
Fix docs Pop2Piano (#30140)
fix copies
parent
af4c0262
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
0 deletions
+10
-0
src/transformers/models/pop2piano/tokenization_pop2piano.py
src/transformers/models/pop2piano/tokenization_pop2piano.py
+10
-0
No files found.
src/transformers/models/pop2piano/tokenization_pop2piano.py
View file @
841e87ef
...
...
@@ -73,6 +73,16 @@ class Pop2PianoTokenizer(PreTrainedTokenizer):
Determines the default velocity to be used while creating midi Notes.
num_bars (`int`, *optional*, defaults to 2):
Determines cutoff_time_idx in for each token.
unk_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to `"-1"`):
The unknown token. A token that is not in the vocabulary cannot be converted to an ID and is set to be this
token instead.
eos_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to 1):
The end of sequence token.
pad_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to 0):
A special token used to make arrays of tokens the same size for batching purpose. Will then be ignored by
attention mechanisms or loss computation.
bos_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to 2):
The beginning of sequence token that was used during pretraining. Can be used a sequence classifier token.
"""
model_input_names
=
[
"token_ids"
,
"attention_mask"
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment