Unverified Commit d4ec9ffb authored by Zhuohan Li's avatar Zhuohan Li Committed by GitHub
Browse files

[Misc] Fix typo in scheduler.py (#4022)

parent 96b6a6d7
......@@ -674,7 +674,7 @@ class Scheduler:
def _schedule_default(self) -> SchedulerOutputs:
"""Schedule queued requests.
The current policy is designed to opimimize the throughput. First,
The current policy is designed to optimize the throughput. First,
it batches as many prefill requests as possible. And it schedules
decodes. If there's a pressure on GPU memory, decode requests can
be swapped or preempted.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment