"doc/git@developer.sourcefind.cn:wangsen/paddle_dbnet.git" did not exist on "b063c417ea5159f13658ac94575cb03878e64610"
Commit b1fd26fe authored by comfyanonymous's avatar comfyanonymous
Browse files

pytorch xpu should be flash or mem efficient attention?

parent 20447e9e
......@@ -693,6 +693,8 @@ def pytorch_attention_flash_attention():
#TODO: more reliable way of checking for flash attention?
if is_nvidia(): #pytorch flash attention only works on Nvidia
return True
if is_intel_xpu():
return True
return False
def force_upcast_attention_dtype():
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment