Skip to content

GitLab

Unverified Commit b8860680 authored by Fanli Lin's avatar Fanli Lin Committed by GitHub
Browse files

[BugFix] Fix RuntimeError in PixtralHFAttention on CPU/XPU (#28444) 


Signed-off-by: default avatarLin, Fanli <fanli.lin@intel.com>
parent a90ad7d8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/models/pixtral.py
View file @ b8860680
...@@ -1109,7 +1109,7 @@ class PixtralHFAttention(nn.Module): ...@@ -1109,7 +1109,7 @@ class PixtralHFAttention(nn.Module):
) )
out = out.transpose(1, 2) out = out.transpose(1, 2)
out = out.view(batch, patches, self.n_heads * self.head_dim) out = out.reshape(batch, patches, self.n_heads * self.head_dim)
attn_output, _ = self.o_proj(out) attn_output, _ = self.o_proj(out)
return attn_output, None return attn_output, None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment