Unverified Commit 428bc718 authored by jennyyyyzhen's avatar jennyyyyzhen Committed by GitHub
Browse files

[Bugfix][ROCm] Strip block_size before attention backend validation (#36274)


Signed-off-by: default avatarjennyyyyzhen <yzhen@hmc.edu>
Co-authored-by: default avatarLu Fang <30275821+houseroad@users.noreply.github.com>
parent ff1e3d9c
...@@ -438,6 +438,8 @@ class RocmPlatform(Platform): ...@@ -438,6 +438,8 @@ class RocmPlatform(Platform):
device_capability = cls.get_device_capability() device_capability = cls.get_device_capability()
assert device_capability is not None assert device_capability is not None
attn_selector_config = attn_selector_config._replace(block_size=None)
# First try checking just the selected backend, if there is one. # First try checking just the selected backend, if there is one.
if selected_backend is not None: if selected_backend is not None:
try: try:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment