Skip to content

GitLab

Unverified Commit 16b37f31 authored by Qiu's avatar Qiu Committed by GitHub
Browse files

[bugfix] fix wrong `dcp_local_seq_lens` calc (#27518) 


Signed-off-by: default avatarQiu <qiuchunshuo@huawei.com>
parent 0976711f
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/attention/backends/mla/common.py
View file @ 16b37f31
......@@ -800,7 +800,7 @@ class MLACommonMetadataBuilder(AttentionMetadataBuilder[M]):
dcp_local_seq_lens[:num_decodes] = seq_lens[
:num_decodes
] // self.dcp_world_size + (
self.dcp_rank <= (seq_lens[:num_decodes] - 1) % self.dcp_world_size
self.dcp_rank < seq_lens[:num_decodes] % self.dcp_world_size
)
assert num_decodes + num_prefills == num_reqs
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment