GitLab

Pytorch supports two variants of fp8:
--fp8_e4m3fn-text-enc (the one that seems to give better results)
--fp8_e5m2-text-enc

Do inference in fp32 to make sure quality stays the exact same.

Try to keep models on the vram when possible.

Better lowvram mode for controlnets.