Tiny fix eos handling for PD disaggregation (#12334)

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Tiny fix eos handling for PD disaggregation (#12334)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
358ae356 · Shangming Cai · GitHub · 41c10e67 · 358ae356
Unverified Commit 358ae356 authored Nov 01, 2025 by Shangming Cai Committed by GitHub Oct 31, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

python/sglang/srt/disaggregation/decode.py python/sglang/srt/disaggregation/decode.py +1 -1

No files found.
--- a/python/sglang/srt/disaggregation/decode.py
+++ b/python/sglang/srt/disaggregation/decode.py
@@ -776,7 +776,7 @@ class DecodeTransferQueue:
                # special handling for corner cases
                should_finish = (
                    decode_req.req.sampling_params.max_new_tokens == 1
-                    or output_id in decode_req.req.eos_token_ids
+                    or decode_req.req.output_ids[-1] in decode_req.req.eos_token_ids
                )
                if should_finish:
                    # finish immediately