Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8d6b0b0a
Commit
8d6b0b0a
authored
Nov 10, 2025
by
zhuwenwen
Browse files
Merge branch 'v0.9.2-dev-wm-1110' into 'v0.9.2-dev'
[fix]修复mtp中的笔误 See merge request dcutoolkit/deeplearing/vllm!249
parents
475128c1
d21e2db7
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
vllm/v1/attention/backends/mla/common.py
vllm/v1/attention/backends/mla/common.py
+1
-1
No files found.
vllm/v1/attention/backends/mla/common.py
View file @
8d6b0b0a
...
...
@@ -402,7 +402,7 @@ class MLACommonMetadataBuilder(AttentionMetadataBuilder[M]):
self
.
decode_token_num_threshold
=
1
vllm_config
=
get_current_vllm_config
()
speculative_config
=
vllm_config
.
speculative_config
if
speculative_config
and
speculative_config
.
num_speculative_tokens
>
1
:
if
speculative_config
and
speculative_config
.
num_speculative_tokens
>
0
:
self
.
use_spec_decode
=
True
self
.
decode_token_num_threshold
=
1
+
speculative_config
.
num_speculative_tokens
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment