• Kadir Nar's avatar
    [Core] Add FreeU mechanism (#5164) · 84b82a6c
    Kadir Nar authored
    *  Added Fourier filter function to upsample blocks
    
    * 🔧 Update Fourier_filter for float16 support
    
    *  Added UNetFreeUConfig to UNet model for FreeU adaptation 🛠
    
    ️
    
    * move unet to its original form and add fourier_filter to torch_utils.
    
    * implement freeU enable mechanism
    
    * implement disable mechanism
    
    * resolution index.
    
    * correct resolution idx condition.
    
    * fix copies.
    
    * no need to use resolution_idx in vae.
    
    * spell out the kwargs
    
    * proper config property
    
    * fix attribution setting
    
    * place unet hasattr properly.
    
    * fix: attribute access.
    
    * proper disable
    
    * remove validation method.
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * debug
    
    * potential fix.
    
    * add: doc.
    
    * fix copies
    
    * add: tests.
    
    * add: support freeU in SDXL.
    
    * set default value of resolution idx.
    
    * set default values for resolution_idx.
    
    * fix copies
    
    * fix rest.
    
    * fix copies
    
    * address PR comments.
    
    * run fix-copies
    
    * move apply_free_u to utils and other minors.
    
    * introduce support for video (unet3D)
    
    * minor ups
    
    * consistent fix-copies.
    
    * consistent stuff
    
    * fix-copies
    
    * add: rest
    
    * add: docs.
    
    * fix: tests
    
    * fix: doc path
    
    * Apply suggestions from code review
    Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
    
    * style up
    
    * move to techniques.
    
    * add: slow test for sd freeu.
    
    * add: slow test for sd freeu.
    
    * add: slow test for sd freeu.
    
    * add: slow test for sd freeu.
    
    * add: slow test for sd freeu.
    
    * add: slow test for sd freeu.
    
    * add: slow test for video with freeu
    
    * add: slow test for video with freeu
    
    * add: slow test for video with freeu
    
    * style
    
    ---------
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
    84b82a6c
freeu.md 4.26 KB