GitLab

Use a simple CLIP model implementation instead of the one from
transformers.

This will allow some interesting things that would too hackish to implement
using the transformers implementation.

--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.

Now everything in transformer_options gets put in extra_options.

There's no reason for the whole CrossAttention object to be repeated when
only the operation in the middle changes.