Commit 2545ed1c authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-fix' into 'v0.9.2-dev'

fix: 修复重复判断逻辑

See merge request dcutoolkit/deeplearing/vllm!406
parents fa683b07 7acefb55
...@@ -280,7 +280,6 @@ class Scheduler(SchedulerInterface): ...@@ -280,7 +280,6 @@ class Scheduler(SchedulerInterface):
num_new_tokens, num_new_tokens,
num_draft_tokens=num_draft_tokens, num_draft_tokens=num_draft_tokens,
num_lookahead_tokens=self.num_lookahead_tokens) num_lookahead_tokens=self.num_lookahead_tokens)
if new_blocks is None:
if new_blocks is None: if new_blocks is None:
if self.use_pp: if self.use_pp:
preemptable_reqs = [r for r in self.running if preemptable_reqs = [r for r in self.running if
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment