"docs/design-docs/dynamo-flow.md" did not exist on "bbe82f182a09c8776e57dca5935f85360d97f3e1"
Unverified Commit 09ad3b76 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Bug] Fix attention_backend arg string parsing (#30534)


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent dc13c99e
......@@ -1649,6 +1649,12 @@ class EngineArgs:
"attention_backend and attention_config.backend "
"are mutually exclusive"
)
# Convert string to enum if needed (CLI parsing returns a string)
if isinstance(self.attention_backend, str):
attention_config.backend = AttentionBackendEnum[
self.attention_backend.upper()
]
else:
attention_config.backend = self.attention_backend
load_config = self.create_load_config()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment