Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
0583578f
Unverified
Commit
0583578f
authored
Aug 28, 2025
by
Jean Schmidt
Committed by
GitHub
Aug 28, 2025
Browse files
[ci] breaks down V1 Test into 3 groups of approx 30 minutes runtime (#23757)
Signed-off-by:
Jean Schmidt
<
contato@jschmidt.me
>
parent
db74d604
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
20 additions
and
6 deletions
+20
-6
.buildkite/test-pipeline.yaml
.buildkite/test-pipeline.yaml
+20
-6
No files found.
.buildkite/test-pipeline.yaml
View file @
0583578f
...
...
@@ -234,16 +234,33 @@ steps:
# OOM in the CI unless we run this separately
-
pytest -v -s tokenization
-
label
:
V1 Test
-
label
:
V1 Test
e2e + engine
mirror_hardwares
:
[
amdexperimental
]
source_file_dependencies
:
-
vllm/
-
tests/v1
commands
:
# split the test to avoid interference
-
pytest -v -s v1/core
# TODO: accuracy does not match, whether setting
# VLLM_USE_FLASHINFER_SAMPLER or not on H100.
-
pytest -v -s v1/e2e
-
pytest -v -s v1/engine
-
label
:
V1 Test entrypoints
mirror_hardwares
:
[
amdexperimental
]
source_file_dependencies
:
-
vllm/
-
tests/v1
commands
:
-
pytest -v -s v1/entrypoints
-
label
:
V1 Test others
mirror_hardwares
:
[
amdexperimental
]
source_file_dependencies
:
-
vllm/
-
tests/v1
commands
:
# split the test to avoid interference
-
pytest -v -s v1/core
-
pytest -v -s v1/executor
-
pytest -v -s v1/sample
-
pytest -v -s v1/logits_processors
...
...
@@ -256,9 +273,6 @@ steps:
-
pytest -v -s v1/test_utils.py
-
pytest -v -s v1/test_oracle.py
-
pytest -v -s v1/test_metrics_reader.py
# TODO: accuracy does not match, whether setting
# VLLM_USE_FLASHINFER_SAMPLER or not on H100.
-
pytest -v -s v1/e2e
# Integration test for streaming correctness (requires special branch).
-
pip install -U git+https://github.com/robertgshaw2-redhat/lm-evaluation-harness.git@streaming-api
-
pytest -v -s entrypoints/openai/correctness/test_lmeval.py::test_lm_eval_accuracy_v1_engine
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment