Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
a7bc4221
Unverified
Commit
a7bc4221
authored
Oct 10, 2022
by
Yih-Dar
Committed by
GitHub
Oct 10, 2022
Browse files
fix (#19469)
Co-authored-by:
ydshieh
<
ydshieh@users.noreply.github.com
>
parent
25cfd911
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
src/transformers/models/flaubert/tokenization_flaubert.py
src/transformers/models/flaubert/tokenization_flaubert.py
+2
-1
No files found.
src/transformers/models/flaubert/tokenization_flaubert.py
View file @
a7bc4221
...
@@ -261,7 +261,8 @@ class FlaubertTokenizer(PreTrainedTokenizer):
...
@@ -261,7 +261,8 @@ class FlaubertTokenizer(PreTrainedTokenizer):
lang2id
=
lang2id
,
lang2id
=
lang2id
,
id2lang
=
id2lang
,
id2lang
=
id2lang
,
do_lowercase_and_remove_accent
=
do_lowercase_and_remove_accent
,
do_lowercase_and_remove_accent
=
do_lowercase_and_remove_accent
,
do_lowercase
=
do_lowercase
**
kwargs
,
do_lowercase
=
do_lowercase
,
**
kwargs
,
)
)
try
:
try
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment