"docs/vscode:/vscode.git/clone" did not exist on "dc72402b5785a6ffadff59d4e018661278d4b028"
Unverified Commit 0825197b authored by Gregory Shtrasberg's avatar Gregory Shtrasberg Committed by GitHub
Browse files

[Bugfix][ROCm][DeepSeek] Fix for forward_hip in rope for DeepSeek (#27373)


Signed-off-by: default avatarGregory Shtrasberg <Gregory.Shtrasberg@amd.com>
parent 9ef3d5b8
...@@ -165,11 +165,8 @@ class RotaryEmbedding(CustomOp): ...@@ -165,11 +165,8 @@ class RotaryEmbedding(CustomOp):
self.rotary_dim, self.rotary_dim,
self.is_neox_style, self.is_neox_style,
) )
else:
# ops.rotary_embedding() is an in-place operation
# that updates the query and key tensors.
self.forward_cuda(positions, query, key)
return query, key return query, key
return self.forward_cuda(positions, query, key)
def forward_xpu( def forward_xpu(
self, self,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment