• Sayak Paul's avatar
    [SDXL DreamBooth LoRA] add support for text encoder fine-tuning (#4097) · 365e8461
    Sayak Paul authored
    
    
    * Allow low precision sd xl
    
    * finish
    
    * finish
    
    * feat: initial draft for supporting text encoder lora finetuning for SDXL DreamBooth
    
    * fix: variable assignments.
    
    * add: autocast block.
    
    * add debugging
    
    * vae dtype hell
    
    * fix: vae dtype hell.
    
    * fix: vae dtype hell 3.
    
    * clean up
    
    * lora text encoder loader.
    
    * fix: unwrapping models.
    
    * add: tests.
    
    * docs.
    
    * handle unexpected keys.
    
    * fix vae dtype in the final inference.
    
    * fix scope problem.
    
    * fix: save_model_card args.
    
    * initialize: prefix to None.
    
    * fix: dtype issues.
    
    * apply gixes.
    
    * debgging.
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * debugging
    
    * add: fast tests.
    
    * pre-tokenize.
    
    * address: will's comments.
    
    * fix: loader and tests.
    
    * fix: dataloader.
    
    * simplify dataloader.
    
    * length.
    
    * simplification.
    
    * make style && make quality
    
    * simplify state_dict munging
    
    * fix: tests.
    
    * fix: state_dict packing.
    
    * Apply suggestions from code review
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    ---------
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    365e8461
loaders.py 92.3 KB