Skip to content

GitLab

Unverified Commit 4207a407 authored by Marc Sun's avatar Marc Sun Committed by GitHub
Browse files

[bnb] Fix offload test (#30039) 

fix bnb test
parent 1ab71364
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
tests/quantization/bnb/test_mixed_int8.py
View file @ 4207a407
...@@ -100,6 +100,8 @@ class BaseMixedInt8Test(unittest.TestCase): ...@@ -100,6 +100,8 @@ class BaseMixedInt8Test(unittest.TestCase):
# Expected values on a A10 # Expected values on a A10
EXPECTED_OUTPUTS.add("Hello my name is John.\nI am a friend of your father.\n") EXPECTED_OUTPUTS.add("Hello my name is John.\nI am a friend of your father.\n")
MAX_NEW_TOKENS = 10 MAX_NEW_TOKENS = 10
# Expected values with offload
EXPECTED_OUTPUTS.add("Hello my name is John and I am a professional photographer based in")
def setUp(self): def setUp(self):
# Models and tokenizer # Models and tokenizer
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment