[Bugfix] Fix two batch overlap with auto DeepEP Dispatch (#7853)

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

[Bugfix] Fix two batch overlap with auto DeepEP Dispatch (#7853)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
d379bda4 · Shangming Cai · GitHub · 2b0e1d1c · d379bda4
Unverified Commit d379bda4 authored Jul 08, 2025 by Shangming Cai Committed by GitHub Jul 08, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

python/sglang/srt/two_batch_overlap.py python/sglang/srt/two_batch_overlap.py +1 -0

No files found.
--- a/python/sglang/srt/two_batch_overlap.py
+++ b/python/sglang/srt/two_batch_overlap.py
@@ -490,6 +490,7 @@ class TboForwardBatchPreparer:
        output_dict["spec_info"] = output_spec_info
        for key in [
            "forward_mode",
+            "is_extend_in_batch",
            "return_logprob",
            "req_to_token_pool",
            "token_to_kv_pool",