Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
9f8cb81b
Unverified
Commit
9f8cb81b
authored
Feb 02, 2026
by
Matthew Bonanni
Committed by
GitHub
Feb 02, 2026
Browse files
[CI] Add DeepSeek V3.2 nightly eval (#33566)
Signed-off-by:
Matthew Bonanni
<
mbonanni@redhat.com
>
parent
d7e17aaa
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
24 additions
and
0 deletions
+24
-0
tests/evals/gsm8k/configs/DeepSeek-V3.2-DP.yaml
tests/evals/gsm8k/configs/DeepSeek-V3.2-DP.yaml
+11
-0
tests/evals/gsm8k/configs/DeepSeek-V3.2-TP.yaml
tests/evals/gsm8k/configs/DeepSeek-V3.2-TP.yaml
+11
-0
tests/evals/gsm8k/configs/models-h200.txt
tests/evals/gsm8k/configs/models-h200.txt
+2
-0
No files found.
tests/evals/gsm8k/configs/DeepSeek-V3.2-DP.yaml
0 → 100644
View file @
9f8cb81b
model_name
:
"
deepseek-ai/DeepSeek-V3.2"
accuracy_threshold
:
0.95
num_questions
:
1319
num_fewshot
:
5
startup_max_wait_seconds
:
1200
server_args
:
>-
--enforce-eager
--max-model-len 4096
--data-parallel-size 8
--enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}'
tests/evals/gsm8k/configs/DeepSeek-V3.2-TP.yaml
0 → 100644
View file @
9f8cb81b
model_name
:
"
deepseek-ai/DeepSeek-V3.2"
accuracy_threshold
:
0.95
num_questions
:
1319
num_fewshot
:
5
startup_max_wait_seconds
:
1200
server_args
:
>-
--enforce-eager
--max-model-len 4096
--tensor-parallel-size 8
--enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}'
tests/evals/gsm8k/configs/models-h200.txt
View file @
9f8cb81b
DeepSeek-R1-TP.yaml
DeepSeek-R1-DP.yaml
DeepSeek-V3.2-TP.yaml
DeepSeek-V3.2-DP.yaml
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment