Skip to content

GitLab

"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "e31446b6c8d887cdca031abf8527555adee46058"
Unverified Commit 8e1fd5ba authored by Matthew Bonanni's avatar Matthew Bonanni Committed by GitHub
Browse files

[CI] Bump `num_speculative_tokens` to 3 in nightly DeepSeek tests (#35882) 


Signed-off-by: default avatarMatthew Bonanni <mbonanni@redhat.com>
parent ae88468b
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 4 deletions
tests/evals/gsm8k/configs/DeepSeek-R1-DP.yaml
View file @ 8e1fd5ba
...@@ -8,4 +8,4 @@ server_args: >- ...@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096 --max-model-len 4096
--data-parallel-size 8 --data-parallel-size 8
--enable-expert-parallel --enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}' --speculative-config '{"method":"mtp","num_speculative_tokens":3}'
tests/evals/gsm8k/configs/DeepSeek-R1-TP.yaml
View file @ 8e1fd5ba
...@@ -8,4 +8,4 @@ server_args: >- ...@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096 --max-model-len 4096
--tensor-parallel-size 8 --tensor-parallel-size 8
--enable-expert-parallel --enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}' --speculative-config '{"method":"mtp","num_speculative_tokens":3}'
tests/evals/gsm8k/configs/DeepSeek-V3.2-DP.yaml
View file @ 8e1fd5ba
...@@ -8,4 +8,4 @@ server_args: >- ...@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096 --max-model-len 4096
--data-parallel-size 8 --data-parallel-size 8
--enable-expert-parallel --enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}' --speculative-config '{"method":"mtp","num_speculative_tokens":3}'
tests/evals/gsm8k/configs/DeepSeek-V3.2-TP.yaml
View file @ 8e1fd5ba
...@@ -8,4 +8,4 @@ server_args: >- ...@@ -8,4 +8,4 @@ server_args: >-
--max-model-len 4096 --max-model-len 4096
--tensor-parallel-size 8 --tensor-parallel-size 8
--enable-expert-parallel --enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}' --speculative-config '{"method":"mtp","num_speculative_tokens":3}'
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment