Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
30a3e5af
Unverified
Commit
30a3e5af
authored
Oct 07, 2025
by
Michael Goin
Committed by
GitHub
Oct 07, 2025
Browse files
[CI] Add Qwen3 MoE NVFP4 to Blackwell lm-eval (#26316)
Signed-off-by:
mgoin
<
mgoin64@gmail.com
>
parent
a38c1bfe
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
8 additions
and
1 deletion
+8
-1
.buildkite/test-pipeline.yaml
.buildkite/test-pipeline.yaml
+1
-1
tests/evals/gsm8k/configs/Qwen3-30B-A3B-NVFP4.yaml
tests/evals/gsm8k/configs/Qwen3-30B-A3B-NVFP4.yaml
+6
-0
tests/evals/gsm8k/configs/models-blackwell.txt
tests/evals/gsm8k/configs/models-blackwell.txt
+1
-0
No files found.
.buildkite/test-pipeline.yaml
View file @
30a3e5af
...
...
@@ -868,7 +868,7 @@ steps:
-
pytest -s -v tests/quantization/test_blackwell_moe.py
-
label
:
Blackwell LM Eval Small Models
timeout_in_minutes
:
75
timeout_in_minutes
:
120
gpu
:
b200
optional
:
true
# run on nightlies
source_file_dependencies
:
...
...
tests/evals/gsm8k/configs/Qwen3-30B-A3B-NVFP4.yaml
0 → 100644
View file @
30a3e5af
model_name
:
"
nvidia/Qwen3-30B-A3B-FP4"
accuracy_threshold
:
0.89
num_questions
:
1319
num_fewshot
:
5
max_model_len
:
4096
tests/evals/gsm8k/configs/models-blackwell.txt
View file @
30a3e5af
...
...
@@ -2,3 +2,4 @@ Qwen3-0.6B-FP8.yaml
Qwen2.5-VL-3B-Instruct-FP8-dynamic.yaml
Qwen1.5-MoE-W4A16-CT.yaml
DeepSeek-V2-Lite-Instruct-FP8.yaml
Qwen3-30B-A3B-NVFP4.yaml
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment