Skip to content

GitLab

Commit b1fd26fe authored by comfyanonymous's avatar comfyanonymous
Browse files

pytorch xpu should be flash or mem efficient attention?

parent 20447e9e
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
comfy/model_management.py
View file @ b1fd26fe
...@@ -693,6 +693,8 @@ def pytorch_attention_flash_attention(): ...@@ -693,6 +693,8 @@ def pytorch_attention_flash_attention():
#TODO: more reliable way of checking for flash attention? #TODO: more reliable way of checking for flash attention?
if is_nvidia(): #pytorch flash attention only works on Nvidia if is_nvidia(): #pytorch flash attention only works on Nvidia
return True return True
if is_intel_xpu():
return True
return False return False
def force_upcast_attention_dtype(): def force_upcast_attention_dtype():
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment