Skip to content

GitLab

Commit ac182341 authored by 王敏's avatar 王敏
Browse files

[fix]修复091 v0 engine mtp报错问题

parent cd6239dc
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/spec_decode/spec_decode_worker.py
View file @ ac182341
...@@ -749,7 +749,7 @@ class SpecDecodeWorker(LoRANotSupportedWorkerBase): ...@@ -749,7 +749,7 @@ class SpecDecodeWorker(LoRANotSupportedWorkerBase):
seq_group_meta_with_hidden): seq_group_meta_with_hidden):
self.previous_hidden_states.update(hidden_states, self.previous_hidden_states.update(hidden_states,
seq_group_meta_with_hidden) seq_group_meta_with_hidden)
self.previous_hidden_states.prune(seq_group_meta_with_hidden) #self.previous_hidden_states.prune(seq_group_meta_with_hidden)
# Store logits from target model execution. # Store logits from target model execution.
if self.tree_decoding: if self.tree_decoding:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment