Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
b79f75fd
Unverified
Commit
b79f75fd
authored
Oct 17, 2025
by
Yineng Zhang
Committed by
GitHub
Oct 17, 2025
Browse files
[Auto Sync] Update scheduler.py (20251017) (#11738)
parent
8fcc69e7
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
0 deletions
+7
-0
python/sglang/srt/managers/scheduler.py
python/sglang/srt/managers/scheduler.py
+7
-0
No files found.
python/sglang/srt/managers/scheduler.py
View file @
b79f75fd
...
...
@@ -2166,6 +2166,12 @@ class Scheduler(
batch
.
prepare_for_decode
()
return
batch
# placeholder for override
def
update_cache_from_scheduler
(
self
,
schedule_batch
:
ScheduleBatch
,
batch_result
:
GenerationBatchResult
):
pass
def
run_batch
(
self
,
batch
:
ScheduleBatch
)
->
Union
[
GenerationBatchResult
,
EmbeddingBatchResult
]:
...
...
@@ -2242,6 +2248,7 @@ class Scheduler(
batch_or_worker_batch
)
future_indices_or_next_token_ids
=
batch_result
.
next_token_ids
self
.
update_cache_from_scheduler
(
batch
,
batch_result
)
# NOTE: future_indices_or_next_token_ids is used in ScheduleBatch,
# which can probably be replaced by future_indices later [TODO(lsyin)].
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment