Unverified Commit e27d25a0 authored by ZiTian.Zhao's avatar ZiTian.Zhao Committed by GitHub
Browse files

[fix] fix correct assertion syntax error in attention utils. (#22154)


Signed-off-by: default avatarzitian.zhao <zitian.zhao@tencentmusic.com>
parent 6f547829
......@@ -97,7 +97,9 @@ def _make_metadata_with_slice(
query_start_loc = slice_query_start_locs(attn_metadata.query_start_loc,
request_slice)
assert len(query_start_loc >= 2)
assert len(query_start_loc) >= 2, (
f"query_start_loc must have at least 2 elements, "
f"got {len(query_start_loc)}")
query_start_loc_cpu = slice_query_start_locs(
attn_metadata.query_start_loc_cpu, request_slice)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment