Support logprobs in two-batch overlap (#7709)

a291439a · fzyzcjy · GitHub · 54411f6a · a291439a
Unverified Commit a291439a authored Jul 06, 2025 by fzyzcjy Committed by GitHub Jul 05, 2025
Show whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

python/sglang/srt/two_batch_overlap.py python/sglang/srt/two_batch_overlap.py +2 -0

No files found.
--- a/python/sglang/srt/two_batch_overlap.py
+++ b/python/sglang/srt/two_batch_overlap.py
@@ -550,6 +550,8 @@ class TboForwardBatchPreparer:
                top_p_normalized_logprobs=False,
                top_p=None,
                mm_inputs=None,
+                top_logprobs_nums=None,
+                token_ids_logprobs=None,
            )
        )