Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
561d6f80
Unverified
Commit
561d6f80
authored
Sep 04, 2024
by
Woosuk Kwon
Committed by
GitHub
Sep 04, 2024
Browse files
[CI] Change test input in Gemma LoRA test (#8163)
parent
d1dec642
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
2 deletions
+3
-2
tests/lora/test_gemma.py
tests/lora/test_gemma.py
+3
-2
No files found.
tests/lora/test_gemma.py
View file @
561d6f80
...
...
@@ -13,7 +13,7 @@ def do_sample(llm: vllm.LLM, lora_path: str, lora_id: int) -> List[str]:
prompts
=
[
"Quote: Imagination is"
,
"Quote: Be yourself;"
,
"Quote:
So many books
,"
,
"Quote:
Painting is poetry that is seen rather than felt
,"
,
]
sampling_params
=
vllm
.
SamplingParams
(
temperature
=
0
,
max_tokens
=
32
)
outputs
=
llm
.
generate
(
...
...
@@ -41,7 +41,8 @@ def test_gemma_lora(gemma_lora_files):
expected_lora_output
=
[
"more important than knowledge.
\n
Author: Albert Einstein
\n
"
,
"everyone else is already taken.
\n
Author: Oscar Wilde
\n
"
,
"so little time
\n
Author: Frank Zappa
\n
"
,
"and poetry is painting that is felt rather than seen.
\n
"
"Author: Leonardo da Vinci
\n
"
,
]
output1
=
do_sample
(
llm
,
gemma_lora_files
,
lora_id
=
1
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment