Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
jerrrrry
infinilm
Commits
f053fe1d
Commit
f053fe1d
authored
Feb 12, 2026
by
wooway777
Committed by
thatPepe
Feb 12, 2026
Browse files
issue/221 - patch encode plus for ali
parent
0879747e
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
examples/jiuge.py
examples/jiuge.py
+1
-1
No files found.
examples/jiuge.py
View file @
f053fe1d
...
...
@@ -202,7 +202,7 @@ def test(
# input_ids_list = tokenizer.batch_encode_plus(input_contents)[
# "input_ids"
# ] # List: [[1, 1128, 526, 366, 29892]]
if
version
.
parse
(
transformers
.
__version__
)
==
version
.
parse
(
"
4.55
.0"
):
if
version
.
parse
(
transformers
.
__version__
)
<
version
.
parse
(
"
5.0
.0"
):
# Ideally this is solved by upgrading transformers. However, doing so causes version mismatch between transformers and mlu pytorch on devices with Phytium CPU. So a branch is temporarily used.
input_ids_list
=
[
tokenizer
.
encode_plus
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment