Unverified Commit 87efc681 authored by Huamin Li's avatar Huamin Li Committed by GitHub
Browse files

llama4_vision_rope: add HIP override to accept (q, k) and avoid (positions, q, k) mismatch (#26790)


Signed-off-by: default avatarHuamin Li <3ericli@gmail.com>
parent c3a722fc
...@@ -78,3 +78,10 @@ class Llama4VisionRotaryEmbedding(RotaryEmbedding): ...@@ -78,3 +78,10 @@ class Llama4VisionRotaryEmbedding(RotaryEmbedding):
key: torch.Tensor | None = None, key: torch.Tensor | None = None,
) -> tuple[torch.Tensor, torch.Tensor | None]: ) -> tuple[torch.Tensor, torch.Tensor | None]:
return self.forward_native(query, key) return self.forward_native(query, key)
def forward_hip( # type: ignore[override]
self,
query: torch.Tensor,
key: torch.Tensor | None = None,
) -> tuple[torch.Tensor, torch.Tensor | None]:
return self.forward_native(query, key)
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment