"lib/bindings/kvbm/Cargo.lock" did not exist on "06b0ebef88c7e8658dbb0ce895e89cf2f5e2ba99"
Commit 65d20f7f authored by wangmin6's avatar wangmin6
Browse files

fix error in test_long_context.py::test_batched_rope_kernel

parent 8ec2f591
......@@ -830,6 +830,7 @@ class ModelRunner:
multi_modal_data=dummy_multi_modal_data,
)
seqs.append(seq)
max_num_batched_tokens -= seq_len
for group_id in range(max_num_seqs):
seq_len = (max_num_batched_tokens // max_num_seqs +
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment