Unverified Commit 49d96538 authored by Divakar Verma's avatar Divakar Verma Committed by GitHub
Browse files

[ROCm][CI] fix get_valid_backends (#32787)


Signed-off-by: default avatarDivakar Verma <divakar.verma@amd.com>
parent a1d82466
...@@ -83,8 +83,14 @@ EXCLUDED_BACKENDS = {AttentionBackendEnum.FLEX_ATTENTION} ...@@ -83,8 +83,14 @@ EXCLUDED_BACKENDS = {AttentionBackendEnum.FLEX_ATTENTION}
def get_available_attention_backends() -> list[str]: def get_available_attention_backends() -> list[str]:
if not hasattr(current_platform, "get_valid_backends"): # Check if get_valid_backends is actually defined in the platform class
return ["FLASH_ATTN"] # (not just returning None from __getattr__)
get_valid_backends = getattr(current_platform.__class__, "get_valid_backends", None)
if get_valid_backends is None:
if current_platform.is_rocm():
return ["TRITON_ATTN"]
else:
return ["FLASH_ATTN"]
device_capability = current_platform.get_device_capability() device_capability = current_platform.get_device_capability()
if device_capability is None: if device_capability is None:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment