Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e6759754
Unverified
Commit
e6759754
authored
Sep 06, 2025
by
Aaron Pham
Committed by
GitHub
Sep 07, 2025
Browse files
[CI][Fix] deterministic seed for flaky CI runs on structured outputs (#24380)
Signed-off-by:
Aaron Pham
<
contact@aarnphm.xyz
>
parent
37a6fa95
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
tests/v1/entrypoints/llm/test_struct_output_generate.py
tests/v1/entrypoints/llm/test_struct_output_generate.py
+3
-3
No files found.
tests/v1/entrypoints/llm/test_struct_output_generate.py
View file @
e6759754
...
@@ -41,9 +41,8 @@ EAGLE_SPEC_CONFIG = {
...
@@ -41,9 +41,8 @@ EAGLE_SPEC_CONFIG = {
PARAMS_MODELS_BACKENDS_TOKENIZER_MODE
=
[
PARAMS_MODELS_BACKENDS_TOKENIZER_MODE
=
[
(
"mistralai/Ministral-8B-Instruct-2410"
,
"xgrammar"
,
"auto"
,
None
),
(
"mistralai/Ministral-8B-Instruct-2410"
,
"xgrammar"
,
"auto"
,
None
),
(
"mistralai/Ministral-8B-Instruct-2410"
,
"guidance"
,
"auto"
,
None
),
(
"mistralai/Ministral-8B-Instruct-2410"
,
"guidance"
,
"auto"
,
None
),
#FIXME: This test is flaky on CI thus disabled
(
"mistralai/Ministral-8B-Instruct-2410"
,
"lm-format-enforcer"
,
"auto"
,
#("mistralai/Ministral-8B-Instruct-2410", "lm-format-enforcer", "auto",
None
),
# None),
(
"mistralai/Ministral-8B-Instruct-2410"
,
"xgrammar"
,
"mistral"
,
None
),
(
"mistralai/Ministral-8B-Instruct-2410"
,
"xgrammar"
,
"mistral"
,
None
),
(
"Qwen/Qwen2.5-1.5B-Instruct"
,
"xgrammar"
,
"auto"
,
None
),
(
"Qwen/Qwen2.5-1.5B-Instruct"
,
"xgrammar"
,
"auto"
,
None
),
(
"Qwen/Qwen2.5-1.5B-Instruct"
,
"lm-format-enforcer"
,
"auto"
,
None
),
(
"Qwen/Qwen2.5-1.5B-Instruct"
,
"lm-format-enforcer"
,
"auto"
,
None
),
...
@@ -123,6 +122,7 @@ def test_structured_output(
...
@@ -123,6 +122,7 @@ def test_structured_output(
guided_decoding_backend
=
guided_decoding_backend
,
guided_decoding_backend
=
guided_decoding_backend
,
guided_decoding_disable_any_whitespace
=
(
guided_decoding_backend
guided_decoding_disable_any_whitespace
=
(
guided_decoding_backend
in
{
"xgrammar"
,
"guidance"
}),
in
{
"xgrammar"
,
"guidance"
}),
seed
=
120
,
tokenizer_mode
=
tokenizer_mode
,
tokenizer_mode
=
tokenizer_mode
,
speculative_config
=
speculative_config
)
speculative_config
=
speculative_config
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment