Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
95f0dd21
Unverified
Commit
95f0dd21
authored
Jan 13, 2023
by
Arthur
Committed by
GitHub
Jan 13, 2023
Browse files
[Tokenizers] Fix a small typo (#21104)
* typo * change name in `__repr__` * fix my mistake
parent
b210c83a
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
src/transformers/tokenization_utils_base.py
src/transformers/tokenization_utils_base.py
+2
-2
No files found.
src/transformers/tokenization_utils_base.py
View file @
95f0dd21
...
@@ -1572,8 +1572,8 @@ class PreTrainedTokenizerBase(SpecialTokensMixin, PushToHubMixin):
...
@@ -1572,8 +1572,8 @@ class PreTrainedTokenizerBase(SpecialTokensMixin, PushToHubMixin):
def
__repr__
(
self
)
->
str
:
def
__repr__
(
self
)
->
str
:
return
(
return
(
f
"
{
'PreTrainedTokenizerFast'
if
self
.
is_fast
else
'PreTrainedTokenizer'
}
(name_or_path='
{
self
.
name_or_path
}
',"
f
"
{
self
.
__class__
.
__name__
}
(name_or_path='
{
self
.
name_or_path
}
',"
f
" vocab_size=
{
self
.
vocab_size
}
, model_max_len=
{
self
.
model_max_length
}
, is_fast=
{
self
.
is_fast
}
,"
f
" vocab_size=
{
self
.
vocab_size
}
, model_max_len
gth
=
{
self
.
model_max_length
}
, is_fast=
{
self
.
is_fast
}
,"
f
" padding_side='
{
self
.
padding_side
}
', truncation_side='
{
self
.
truncation_side
}
',"
f
" padding_side='
{
self
.
padding_side
}
', truncation_side='
{
self
.
truncation_side
}
',"
f
" special_tokens=
{
self
.
special_tokens_map_extended
}
)"
f
" special_tokens=
{
self
.
special_tokens_map_extended
}
)"
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment