Unverified Commit 09ad3b76 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Bug] Fix attention_backend arg string parsing (#30534)


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent dc13c99e
......@@ -1649,7 +1649,13 @@ class EngineArgs:
"attention_backend and attention_config.backend "
"are mutually exclusive"
)
attention_config.backend = self.attention_backend
# Convert string to enum if needed (CLI parsing returns a string)
if isinstance(self.attention_backend, str):
attention_config.backend = AttentionBackendEnum[
self.attention_backend.upper()
]
else:
attention_config.backend = self.attention_backend
load_config = self.create_load_config()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment