Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
d4ec9ffb
Unverified
Commit
d4ec9ffb
authored
Apr 12, 2024
by
Zhuohan Li
Committed by
GitHub
Apr 12, 2024
Browse files
[Misc] Fix typo in scheduler.py (#4022)
parent
96b6a6d7
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
vllm/core/scheduler.py
vllm/core/scheduler.py
+1
-1
No files found.
vllm/core/scheduler.py
View file @
d4ec9ffb
...
...
@@ -674,7 +674,7 @@ class Scheduler:
def
_schedule_default
(
self
)
->
SchedulerOutputs
:
"""Schedule queued requests.
The current policy is designed to op
im
imize the throughput. First,
The current policy is designed to op
t
imize the throughput. First,
it batches as many prefill requests as possible. And it schedules
decodes. If there's a pressure on GPU memory, decode requests can
be swapped or preempted.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment