Unverified Commit d379bda4 authored by Shangming Cai's avatar Shangming Cai Committed by GitHub
Browse files

[Bugfix] Fix two batch overlap with auto DeepEP Dispatch (#7853)


Signed-off-by: default avatarShangming Cai <caishangming@linux.alibaba.com>
parent 2b0e1d1c
......@@ -490,6 +490,7 @@ class TboForwardBatchPreparer:
output_dict["spec_info"] = output_spec_info
for key in [
"forward_mode",
"is_extend_in_batch",
"return_logprob",
"req_to_token_pool",
"token_to_kv_pool",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment