"vscode:/vscode.git/clone" did not exist on "8f80b7116aa1e9ded2ad4e3d5bf64755ba6ccbd9"
Unverified Commit 57a810db authored by Aleksandr Malyshev's avatar Aleksandr Malyshev Committed by GitHub
Browse files

[ROCM][V0] PA kennel selection when no sliding window provided (#15982)


Signed-off-by: default avatarAleksandr Malyshev <maleksan@amd.com>
Co-authored-by: default avatarAleksandr Malyshev <maleksan@amd.com>
parent 8b664706
......@@ -109,7 +109,8 @@ def use_rocm_custom_paged_attention(qtype: torch.dtype, head_size: int,
ON_MI250_MI300 = any(arch in GPU_ARCH for arch in ["gfx90a", "gfx942"])
# rocm custom page attention not support on navi (gfx1*)
return (ON_MI250_MI300 and not ON_NAVI and (sliding_window == 0)
return (ON_MI250_MI300 and not ON_NAVI
and (sliding_window == 0 or sliding_window == (-1, -1))
and (qtype == torch.half or qtype == torch.bfloat16)
and (head_size == 64 or head_size == 128)
and (block_size == 16 or block_size == 32)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment