Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
4207a407
Unverified
Commit
4207a407
authored
Apr 05, 2024
by
Marc Sun
Committed by
GitHub
Apr 05, 2024
Browse files
[bnb] Fix offload test (#30039)
fix bnb test
parent
1ab71364
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
0 deletions
+2
-0
tests/quantization/bnb/test_mixed_int8.py
tests/quantization/bnb/test_mixed_int8.py
+2
-0
No files found.
tests/quantization/bnb/test_mixed_int8.py
View file @
4207a407
...
...
@@ -100,6 +100,8 @@ class BaseMixedInt8Test(unittest.TestCase):
# Expected values on a A10
EXPECTED_OUTPUTS
.
add
(
"Hello my name is John.
\n
I am a friend of your father.
\n
"
)
MAX_NEW_TOKENS
=
10
# Expected values with offload
EXPECTED_OUTPUTS
.
add
(
"Hello my name is John and I am a professional photographer based in"
)
def
setUp
(
self
):
# Models and tokenizer
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment