Skip to content

GitLab

Unverified Commit 8e1fd5ba authored by Matthew Bonanni's avatar Matthew Bonanni Committed by GitHub
Browse files

[CI] Bump `num_speculative_tokens` to 3 in nightly DeepSeek tests (#35882) 


Signed-off-by: default avatarMatthew Bonanni <mbonanni@redhat.com>
parent ae88468b
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 4 deletions
tests/evals/gsm8k/configs/DeepSeek-R1-DP.yaml
View file @ 8e1fd5ba
......@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096
--data-parallel-size 8
--enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}'
--speculative-config '{"method":"mtp","num_speculative_tokens":3}'
tests/evals/gsm8k/configs/DeepSeek-R1-TP.yaml
View file @ 8e1fd5ba
......@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096
--tensor-parallel-size 8
--enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}'
--speculative-config '{"method":"mtp","num_speculative_tokens":3}'
tests/evals/gsm8k/configs/DeepSeek-V3.2-DP.yaml
View file @ 8e1fd5ba
......@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096
--data-parallel-size 8
--enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}'
--speculative-config '{"method":"mtp","num_speculative_tokens":3}'
tests/evals/gsm8k/configs/DeepSeek-V3.2-TP.yaml
View file @ 8e1fd5ba
......@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096
--tensor-parallel-size 8
--enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}'
--speculative-config '{"method":"mtp","num_speculative_tokens":3}'
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment