Skip to content

GitLab

Unverified Commit 41f38844 authored by quanliu's avatar quanliu Committed by GitHub
Browse files

[Bugfix][Core]Fix block table out-of-range issue in priority scheduling (#26661) 


Signed-off-by: liuquan's avatarquanliu <18646313696@163.com>
parent 60e419c1
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
vllm/v1/core/sched/scheduler.py
View file @ 41f38844
...@@ -271,6 +271,9 @@ class Scheduler(SchedulerInterface): ...@@ -271,6 +271,9 @@ class Scheduler(SchedulerInterface):
self.running.remove(preempted_req) self.running.remove(preempted_req)
if preempted_req in scheduled_running_reqs: if preempted_req in scheduled_running_reqs:
scheduled_running_reqs.remove(preempted_req) scheduled_running_reqs.remove(preempted_req)
token_budget += num_scheduled_tokens[preempted_req.request_id]
req_to_new_blocks.pop(preempted_req.request_id)
num_scheduled_tokens.pop(preempted_req.request_id)
else: else:
preempted_req = self.running.pop() preempted_req = self.running.pop()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment