Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
dd83e7e9
Unverified
Commit
dd83e7e9
authored
Apr 16, 2025
by
ybyang
Committed by
GitHub
Apr 16, 2025
Browse files
[Bug fix] need record start time in pd mode (#5425)
parent
0769b14b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
3 deletions
+1
-3
python/sglang/srt/managers/scheduler.py
python/sglang/srt/managers/scheduler.py
+1
-3
No files found.
python/sglang/srt/managers/scheduler.py
View file @
dd83e7e9
...
...
@@ -959,14 +959,12 @@ class Scheduler(
self
.
_add_request_to_queue
(
req
)
def
_add_request_to_queue
(
self
,
req
:
Req
):
req
.
queue_time_start
=
time
.
time
()
if
self
.
disaggregation_mode
==
DisaggregationMode
.
PREFILL
:
self
.
disagg_prefill_pending_queue
.
add
(
req
)
elif
self
.
disaggregation_mode
==
DisaggregationMode
.
DECODE
:
self
.
disagg_decode_prealloc_queue
.
add
(
req
)
else
:
req
.
queue_time_start
=
time
.
time
()
self
.
waiting_queue
.
append
(
req
)
def
_extend_requests_to_queue
(
self
,
reqs
:
List
[
Req
],
is_retracted
:
bool
=
False
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment