Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
39a22dca
Unverified
Commit
39a22dca
authored
Sep 01, 2025
by
Woosuk Kwon
Committed by
GitHub
Sep 01, 2025
Browse files
[Misc] Minor code simplification for spec decode (#24053)
Signed-off-by:
Woosuk Kwon
<
woosuk.kwon@berkeley.edu
>
parent
41c80698
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
7 deletions
+7
-7
vllm/v1/core/sched/scheduler.py
vllm/v1/core/sched/scheduler.py
+7
-7
No files found.
vllm/v1/core/sched/scheduler.py
View file @
39a22dca
...
...
@@ -873,19 +873,19 @@ class Scheduler(SchedulerInterface):
scheduled_spec_token_ids
=
(
scheduler_output
.
scheduled_spec_decode_tokens
.
get
(
req_id
))
if
scheduled_spec_token_ids
:
num_draft_tokens
=
len
(
scheduled_spec_token_ids
)
num_accepted
=
len
(
generated_token_ids
)
-
1
num_rejected
=
num_draft_tokens
-
num_accepted
# num_computed_tokens represents the number of tokens
# processed in the current step, considering scheduled
# tokens and rejections. If some tokens are rejected,
# num_computed_tokens is decreased by the number of rejected
# tokens, where is given by:
# len(scheduled_spec_token_ids) + 1 - len(generated_token_ids).
num_tokens_rejected
=
(
len
(
scheduled_spec_token_ids
)
+
1
-
len
(
generated_token_ids
))
request
.
num_computed_tokens
-=
num_tokens_rejected
# tokens.
request
.
num_computed_tokens
-=
num_rejected
spec_decoding_stats
=
self
.
make_spec_decoding_stats
(
spec_decoding_stats
,
num_draft_tokens
=
len
(
scheduled_spec
_token
_ids
)
,
num_accepted_tokens
=
len
(
generated_token_ids
)
-
1
)
num_draft_tokens
=
num_draft
_token
s
,
num_accepted_tokens
=
num_accepted
)
stopped
=
False
new_logprobs
=
None
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment