Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
841e87ef
Unverified
Commit
841e87ef
authored
Apr 09, 2024
by
Raushan Turganbay
Committed by
GitHub
Apr 09, 2024
Browse files
Fix docs Pop2Piano (#30140)
fix copies
parent
af4c0262
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
0 deletions
+10
-0
src/transformers/models/pop2piano/tokenization_pop2piano.py
src/transformers/models/pop2piano/tokenization_pop2piano.py
+10
-0
No files found.
src/transformers/models/pop2piano/tokenization_pop2piano.py
View file @
841e87ef
...
@@ -73,6 +73,16 @@ class Pop2PianoTokenizer(PreTrainedTokenizer):
...
@@ -73,6 +73,16 @@ class Pop2PianoTokenizer(PreTrainedTokenizer):
Determines the default velocity to be used while creating midi Notes.
Determines the default velocity to be used while creating midi Notes.
num_bars (`int`, *optional*, defaults to 2):
num_bars (`int`, *optional*, defaults to 2):
Determines cutoff_time_idx in for each token.
Determines cutoff_time_idx in for each token.
unk_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to `"-1"`):
The unknown token. A token that is not in the vocabulary cannot be converted to an ID and is set to be this
token instead.
eos_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to 1):
The end of sequence token.
pad_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to 0):
A special token used to make arrays of tokens the same size for batching purpose. Will then be ignored by
attention mechanisms or loss computation.
bos_token (`str` or `tokenizers.AddedToken`, *optional*, defaults to 2):
The beginning of sequence token that was used during pretraining. Can be used a sequence classifier token.
"""
"""
model_input_names
=
[
"token_ids"
,
"attention_mask"
]
model_input_names
=
[
"token_ids"
,
"attention_mask"
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment