"host/solver/include/solver_common.hpp" did not exist on "f63a23acb14867da6f4a234aae19227a0847b4e6"
Commit 5f0f9763 authored by comfyanonymous's avatar comfyanonymous
Browse files

Only clear cuda cache on CUDA since it causes slowdowns on ROCm.

parent b31daadc
......@@ -189,6 +189,8 @@ class PromptExecutor:
self.server.send_sync("executing", { "node": None }, self.server.client_id)
gc.collect()
if torch.cuda.is_available():
if torch.version.cuda: #This seems to make things worse on ROCm so I only do it for cuda
torch.cuda.empty_cache()
torch.cuda.ipc_collect()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment