• Will Berman's avatar
    if dreambooth lora (#3360) · a757b2db
    Will Berman authored
    * update IF stage I pipelines
    
    add fixed variance schedulers and lora loading
    
    * added kv lora attn processor
    
    * allow loading into alternative lora attn processor
    
    * make vae optional
    
    * throw away predicted variance
    
    * allow loading into added kv lora layer
    
    * allow load T5
    
    * allow pre compute text embeddings
    
    * set new variance type in schedulers
    
    * fix copies
    
    * refactor all prompt embedding code
    
    class prompts are now included in pre-encoding code
    max tokenizer length is now configurable
    embedding attention mask is now configurable
    
    * fix for when variance type is not defined on scheduler
    
    * do not pre compute validation prompt if not present
    
    * add example test for if lora dreambooth
    
    * add check for train text encoder and pre compute text embeddings
    a757b2db
loaders.py 66.1 KB