"vscode:/vscode.git/clone" did not exist on "235727fed79880ac2053a1db1b0d13c0f75714e8"
Commit b1fd26fe authored by comfyanonymous's avatar comfyanonymous
Browse files

pytorch xpu should be flash or mem efficient attention?

parent 20447e9e
......@@ -693,6 +693,8 @@ def pytorch_attention_flash_attention():
#TODO: more reliable way of checking for flash attention?
if is_nvidia(): #pytorch flash attention only works on Nvidia
return True
if is_intel_xpu():
return True
return False
def force_upcast_attention_dtype():
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment