Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
a0c212c0
Commit
a0c212c0
authored
May 08, 2025
by
zhuwenwen
Browse files
fix mtp run error
parent
3d83fa41
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
vllm/spec_decode/spec_decode_worker.py
vllm/spec_decode/spec_decode_worker.py
+1
-1
No files found.
vllm/spec_decode/spec_decode_worker.py
View file @
a0c212c0
...
...
@@ -434,7 +434,7 @@ class SpecDecodeWorker(LoRANotSupportedWorkerBase):
# tree_style decoding modify probs in _verify_tokens
if
not
self
.
tree_decoding
:
(
self
.
scorer_worker
.
model_runner
.
model
.
sampler
.
(
self
.
scorer_worker
.
model_runner
.
sampler
.
should_modify_greedy_probs_inplace
)
=
True
self
.
proposer_worker
.
set_include_gpu_probs_tensor
()
self
.
proposer_worker
.
set_should_modify_greedy_probs_inplace
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment