Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
0cf05716
Commit
0cf05716
authored
Jan 09, 2026
by
jujl1
Browse files
fix: 修复丢弃MTP代码报错
parent
c1795786
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
4 deletions
+3
-4
vllm/v1/worker/gpu_model_runner.py
vllm/v1/worker/gpu_model_runner.py
+3
-4
No files found.
vllm/v1/worker/gpu_model_runner.py
View file @
0cf05716
...
@@ -1643,9 +1643,6 @@ class GPUModelRunnerBase(LoRAModelRunnerMixin):
...
@@ -1643,9 +1643,6 @@ class GPUModelRunnerBase(LoRAModelRunnerMixin):
# Mask out the sampled tokens that should not be sampled.
# Mask out the sampled tokens that should not be sampled.
for
i
in
discard_sampled_tokens_req_indices
:
for
i
in
discard_sampled_tokens_req_indices
:
valid_sampled_token_ids
[
i
].
clear
()
valid_sampled_token_ids
[
i
].
clear
()
if
spec_token_ids
is
not
None
:
for
i
in
discard_sampled_tokens_req_indices
:
spec_token_ids
[
i
].
clear
()
# Cache the sampled tokens in the model runner, so that the scheduler
# Cache the sampled tokens in the model runner, so that the scheduler
# doesn't need to send them back.
# doesn't need to send them back.
...
@@ -1685,7 +1682,9 @@ class GPUModelRunnerBase(LoRAModelRunnerMixin):
...
@@ -1685,7 +1682,9 @@ class GPUModelRunnerBase(LoRAModelRunnerMixin):
spec_decode_metadata
,
spec_decode_metadata
,
attn_metadata
,
attn_metadata
,
)
)
if
spec_token_ids
is
not
None
:
for
i
in
discard_sampled_tokens_req_indices
:
spec_token_ids
[
i
].
clear
()
# Clear KVConnector state after all KVs are generated.
# Clear KVConnector state after all KVs are generated.
if
has_kv_transfer_group
():
if
has_kv_transfer_group
():
get_kv_transfer_group
().
clear_connector_metadata
()
get_kv_transfer_group
().
clear_connector_metadata
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment