Skip to content

GitLab

Unverified Commit b6b40946 authored by Liangsheng Yin's avatar Liangsheng Yin Committed by GitHub
Browse files

Fix filter_batch function call (#1681)

parent f1088e0f
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/managers/schedule_batch.py
View file @ b6b40946
...@@ -649,7 +649,7 @@ class ScheduleBatch: ...@@ -649,7 +649,7 @@ class ScheduleBatch:
req.last_update_decode_tokens = 0 req.last_update_decode_tokens = 0
req.logprob_start_len = 10**9 req.logprob_start_len = 10**9
self.filter_batch(sorted_indices) self.filter_batch(keep_indices=sorted_indices)
# Reqs in batch are filtered # Reqs in batch are filtered
total_decoded_tokens = sum(len(r.output_ids) for r in self.reqs) total_decoded_tokens = sum(len(r.output_ids) for r in self.reqs)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment