Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
b4f0b5f9
Unverified
Commit
b4f0b5f9
authored
Jul 11, 2025
by
QiliangCui
Committed by
GitHub
Jul 11, 2025
Browse files
Temporarily suspend google/gemma-3-1b-it. (#20722)
Signed-off-by:
Qiliang Cui
<
derrhein@gmail.com
>
parent
cbd14ed5
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
0 deletions
+6
-0
tests/entrypoints/llm/test_accuracy.py
tests/entrypoints/llm/test_accuracy.py
+6
-0
No files found.
tests/entrypoints/llm/test_accuracy.py
View file @
b4f0b5f9
...
...
@@ -69,6 +69,12 @@ def test_lm_eval_accuracy_v1_engine(model, monkeypatch: pytest.MonkeyPatch):
more_args
=
None
if
current_platform
.
is_tpu
():
# Limit compilation time for TPU V1
if
model
==
"google/gemma-3-1b-it"
:
pytest
.
skip
(
"Temporarily disabled due to test failures"
"(timeout or accuracy mismatch). Re-enable once fixed."
)
more_args
=
"max_model_len=2048,max_num_seqs=64"
# Add TP test (if provided)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment