Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
12d0eb5f
"web/git@developer.sourcefind.cn:chenpangpang/ComfyUI.git" did not exist on "e45d920ae392c608b9cfcb1f863cfc8688ebb518"
Unverified
Commit
12d0eb5f
authored
Jun 04, 2020
by
Sylvain Gugger
Committed by
GitHub
Jun 04, 2020
Browse files
Don't access pad_token_id if there is no pad_token (#4773)
parent
17a88d31
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
src/transformers/tokenization_utils.py
src/transformers/tokenization_utils.py
+1
-1
No files found.
src/transformers/tokenization_utils.py
View file @
12d0eb5f
...
...
@@ -2467,7 +2467,7 @@ class PreTrainedTokenizerFast(PreTrainedTokenizer):
strategy
=
truncation_strategy
,
pad_to_max_length
=
pad_to_max_length
,
padding_side
=
self
.
padding_side
,
pad_token_id
=
self
.
pad_token_id
,
pad_token_id
=
self
.
pad_token_id
if
self
.
_pad_token
is
not
None
else
None
,
pad_token_type_id
=
self
.
pad_token_type_id
,
pad_token
=
self
.
_pad_token
,
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment