• Sayak Paul's avatar
    [Core] add: controlnet support for SDXL (#4038) · 3eb498e7
    Sayak Paul authored
    * add: controlnet sdxl.
    
    * modifications to controlnet.
    
    * run styling.
    
    * add: __init__.pys
    
    * incorporate https://github.com/huggingface/diffusers/pull/4019
    
     changes.
    
    * run make fix-copies.
    
    * resize the conditioning images.
    
    * remove autocast.
    
    * run styling.
    
    * disable autocast.
    
    * debugging
    
    * device placement.
    
    * back to autocast.
    
    * remove comment.
    
    * save some memory by reusing the vae and unet in the pipeline.
    
    * apply styling.
    
    * Allow low precision sd xl
    
    * finish
    
    * finish
    
    * changes to accommodate the improved VAE.
    
    * modifications to how we handle vae encoding in the training.
    
    * make style
    
    * make existing controlnet fast tests pass.
    
    * change vae checkpoint cli arg.
    
    * fix: vae pretrained paths.
    
    * fix: steps in get_scheduler().
    
    * debugging.
    
    * debugging./
    
    * fix: weight conversion.
    
    * add: docs.
    
    * add: limited tests./
    
    * add: datasets to the requirements.
    
    * update docstrings and incorporate the usage of watermarking.
    
    * incorporate fix from #4083
    
    * fix watermarking dependency handling.
    
    * run make-fix-copies.
    
    * Empty-Commit
    
    * Update requirements_sdxl.txt
    
    * remove vae upcasting part.
    
    * Apply suggestions from code review
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * run make style
    
    * run make fix-copies.
    
    * disable suppot for multicontrolnet.
    
    * Apply suggestions from code review
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * run make fix-copies.
    
    * dtyle/.
    
    * fix-copies.
    
    ---------
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    3eb498e7
__init__.py 7.03 KB