Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
f3222929
Unverified
Commit
f3222929
authored
Nov 06, 2025
by
Michael Goin
Committed by
GitHub
Nov 06, 2025
Browse files
Disable nm-testing models with issues in CI (#28206)
Signed-off-by:
mgoin
<
mgoin64@gmail.com
>
parent
c757a15f
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
4 additions
and
16 deletions
+4
-16
.buildkite/lm-eval-harness/configs/Qwen2-1.5B-Instruct-W8A16-compressed-tensors.yaml
...configs/Qwen2-1.5B-Instruct-W8A16-compressed-tensors.yaml
+0
-12
benchmarks/kernels/benchmark_grouped_gemm_cutlass.py
benchmarks/kernels/benchmark_grouped_gemm_cutlass.py
+2
-2
benchmarks/kernels/benchmark_shapes.py
benchmarks/kernels/benchmark_shapes.py
+2
-2
No files found.
.buildkite/lm-eval-harness/configs/Qwen2-1.5B-Instruct-W8A16-compressed-tensors.yaml
deleted
100644 → 0
View file @
c757a15f
# For vllm script, with -t option (tensor parallel size).
# bash .buildkite/lm-eval-harness/run-lm-eval-gsm-vllm-baseline.sh -m nm-testing/Qwen2-1.5B-Instruct-W8A16-Channelwise -b "auto" -l 1000 -f 5 -t 1
model_name
:
"
nm-testing/Qwen2-1.5B-Instruct-W8A16-Channelwise"
tasks
:
-
name
:
"
gsm8k"
metrics
:
-
name
:
"
exact_match,strict-match"
value
:
0.595
-
name
:
"
exact_match,flexible-extract"
value
:
0.582
limit
:
1000
num_fewshot
:
5
benchmarks/kernels/benchmark_grouped_gemm_cutlass.py
View file @
f3222929
...
...
@@ -16,8 +16,8 @@ from vllm.model_executor.layers.fused_moe.fused_moe import (
from
vllm.utils.argparse_utils
import
FlexibleArgumentParser
DEFAULT_MODELS
=
[
"
nm-testing
/Mixtral-8x7B-Instruct-v0.1"
,
"
nm-testing/d
eep
s
eek
v
2-
l
ite"
,
"
mistralai
/Mixtral-8x7B-Instruct-v0.1"
,
"
deepseek-ai/D
eep
S
eek
-V
2-
L
ite"
,
"ibm-granite/granite-3.0-1b-a400m"
,
"ibm-granite/granite-3.0-3b-a800m"
,
]
...
...
benchmarks/kernels/benchmark_shapes.py
View file @
f3222929
...
...
@@ -78,11 +78,11 @@ WEIGHT_SHAPES = {
}
WEIGHT_SHAPES_MOE
=
{
"
nm-testing
/Mixtral-8x7B-Instruct-v0.1"
:
[
"
mistralai
/Mixtral-8x7B-Instruct-v0.1"
:
[
[
8
,
2
,
4096
,
28672
],
[
8
,
2
,
14336
,
4096
],
],
"
nm-testing/d
eep
s
eek
v
2-
l
ite"
:
[
"
deepseek-ai/D
eep
S
eek
-V
2-
L
ite"
:
[
[
64
,
6
,
2048
,
1408
],
],
"ibm-granite/granite-3.0-1b-a400m"
:
[
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment