Unverified Commit 83e26c83 authored by elvischenv's avatar elvischenv Committed by GitHub
Browse files

[GPT-OSS] Remove unnecessary contiguous (#34337)


Signed-off-by: default avatarelvischenv <219235043+elvischenv@users.noreply.github.com>
parent 50012113
......@@ -140,7 +140,6 @@ class OAIAttention(nn.Module):
qkv, _ = self.qkv_proj(hidden_states)
q, k, v = qkv.split([self.q_size, self.kv_size, self.kv_size], dim=-1)
q, k = self.rotary_emb(positions, q, k)
v = v.contiguous()
attn_output = self.attn(q, k, v)
output, _ = self.o_proj(attn_output)
return output
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment