GitLab

--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.

Control loras are controlnets where some of the weights are stored in
"lora" format: an up and a down low rank matrice that when multiplied
together and added to the unet weight give the controlnet weight.

This allows a much smaller memory footprint depending on the rank of the
matrices.

These controlnets are used just like regular ones.

Large refactor of the model detection and loading code.