Try to keep models on the vram when possible. Better lowvram mode for controlnets.
Attach a file by drag & drop or click to upload