Skip to content

GitLab

Unverified Commit d379bda4 authored by Shangming Cai's avatar Shangming Cai Committed by GitHub
Browse files

[Bugfix] Fix two batch overlap with auto DeepEP Dispatch (#7853) 


Signed-off-by: default avatarShangming Cai <caishangming@linux.alibaba.com>
parent 2b0e1d1c
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
python/sglang/srt/two_batch_overlap.py
View file @ d379bda4
...@@ -490,6 +490,7 @@ class TboForwardBatchPreparer: ...@@ -490,6 +490,7 @@ class TboForwardBatchPreparer:
output_dict["spec_info"] = output_spec_info output_dict["spec_info"] = output_spec_info
for key in [ for key in [
"forward_mode", "forward_mode",
"is_extend_in_batch",
"return_logprob", "return_logprob",
"req_to_token_pool", "req_to_token_pool",
"token_to_kv_pool", "token_to_kv_pool",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment