Unverified Commit 8c50d62f authored by ZiTian Zhao's avatar ZiTian Zhao Committed by GitHub
Browse files

Remove redundant row_indices unsqueeze operation in MiniCPMO (#22528)


Signed-off-by: default avatarzitian.zhao <zitian.zhao@tencentmusic.com>
parent b4e29167
...@@ -605,7 +605,6 @@ class MiniCPMO(MiniCPMV2_6): ...@@ -605,7 +605,6 @@ class MiniCPMO(MiniCPMV2_6):
max=size) max=size)
# Create column indices for broadcasting # Create column indices for broadcasting
col_indices = torch.arange(size, device=device).unsqueeze(0) col_indices = torch.arange(size, device=device).unsqueeze(0)
row_indices = row_indices.unsqueeze(1)
start_indices = start_indices.unsqueeze(1) start_indices = start_indices.unsqueeze(1)
end_indices = end_indices.unsqueeze(1) end_indices = end_indices.unsqueeze(1)
# Vectorized mask creation # Vectorized mask creation
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment