Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
179547d6
Unverified
Commit
179547d6
authored
Mar 09, 2026
by
Andreas Karatzas
Committed by
GitHub
Mar 09, 2026
Browse files
[ROCm][CI] Fix ROCm GPT-OSS Eval test group (#36179)
Signed-off-by:
Andreas Karatzas
<
akaratza@amd.com
>
parent
f85b4eda
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
16 additions
and
4 deletions
+16
-4
.buildkite/test-amd.yaml
.buildkite/test-amd.yaml
+4
-4
tests/evals/gpt_oss/configs/gpt-oss-20b-rocm-baseline.yaml
tests/evals/gpt_oss/configs/gpt-oss-20b-rocm-baseline.yaml
+6
-0
tests/evals/gpt_oss/configs/models-gfx942.txt
tests/evals/gpt_oss/configs/models-gfx942.txt
+3
-0
tests/evals/gpt_oss/configs/models-gfx950.txt
tests/evals/gpt_oss/configs/models-gfx950.txt
+3
-0
No files found.
.buildkite/test-amd.yaml
View file @
179547d6
...
...
@@ -1639,8 +1639,8 @@ steps:
-
vllm/model_executor/layers/quantization/mxfp4.py
-
vllm/v1/attention/backends/flashinfer.py
commands
:
-
uv pip install --system 'gpt-oss[eval]==0.0.5'
-
VLLM_ROCM_USE_AITER_MHA=0 VLLM_ROCM_USE_AITER=1 VLLM_USE_AITER_UNIFIED_ATTENTION=1
pytest -s -v
tests/
evals/gpt_oss/test_gpqa_correctness.py --
model openai/gpt-oss-20b --metric
0.58
-
uv pip install --system 'gpt-oss[eval]==0.0.5'
-
pytest -s -v evals/gpt_oss/test_gpqa_correctness.py --
config-list-file=configs/models-gfx942.txt
##### EPLB Accuracy Tests #####
-
label
:
DeepSeek V2-Lite Accuracy
...
...
@@ -3296,8 +3296,8 @@ steps:
-
vllm/model_executor/layers/quantization/mxfp4.py
-
vllm/v1/attention/backends/flashinfer.py
commands
:
-
uv pip install --system 'gpt-oss[eval]==0.0.5'
-
VLLM_ROCM_USE_AITER_MHA=0 VLLM_ROCM_USE_AITER=1 VLLM_USE_AITER_UNIFIED_ATTENTION=1
pytest -s -v
tests/
evals/gpt_oss/test_gpqa_correctness.py --
model openai/gpt-oss-20b --metric
0.58
-
uv pip install --system 'gpt-oss[eval]==0.0.5'
-
pytest -s -v evals/gpt_oss/test_gpqa_correctness.py --
config-list-file=configs/models-gfx950.txt
##### EPLB Accuracy Tests #####
-
label
:
DeepSeek V2-Lite Accuracy
...
...
tests/evals/gpt_oss/configs/gpt-oss-20b-rocm-baseline.yaml
0 → 100644
View file @
179547d6
# SPDX-License-Identifier: Apache-2.0
# SPDX-FileCopyrightText: Copyright contributors to the vLLM project
model_name
:
openai/gpt-oss-20b
metric_threshold
:
0.568
reasoning_effort
:
low
server_args
:
"
--attention-backend
ROCM_AITER_UNIFIED_ATTN"
\ No newline at end of file
tests/evals/gpt_oss/configs/models-gfx942.txt
0 → 100644
View file @
179547d6
# GFX942 model configurations for GPQA evaluation
# Tests different environment variable combinations
gpt-oss-20b-rocm-baseline.yaml
\ No newline at end of file
tests/evals/gpt_oss/configs/models-gfx950.txt
0 → 100644
View file @
179547d6
# GFX950 model configurations for GPQA evaluation
# Tests different environment variable combinations
gpt-oss-20b-rocm-baseline.yaml
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment