Unverified Commit 8154de5a authored by Xuchun Shang's avatar Xuchun Shang Committed by GitHub
Browse files

[PD] Remove invalid parameter (#4721)


Signed-off-by: default avatarXuchun Shang <xuchun.shang@linux.alibaba.com>
parent c11cfda0
......@@ -158,7 +158,7 @@ class DecodePreallocQueue:
preallocated_reqs = []
indices_to_remove = set()
allocatable_tokens = self._allocatable_tokens(count_retracted=True)
allocatable_tokens = self._allocatable_tokens()
for i, decode_req in enumerate(self.queue):
if not decode_req.waiting_for_input:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment