• Kashif Rasul's avatar
    [Pipiline] Wuerstchen v3 aka Stable Cascasde pipeline (#6487) · 40aa47b9
    Kashif Rasul authored
    
    
    * initial diffNext v3
    
    * move to v3 folder
    
    * imports
    
    * dry up the unets
    
    * no switch_level
    
    * fix init
    
    * add switch_level tp config
    
    * Fixed some things
    
    * Added pooled text embeddings
    
    * Initial work on adding image encoder
    
    * changes from @dome272
    
    * Stuff for the image encoder processing and variable naming in decoder
    
    * fix arg name
    
    * inference fixes
    
    * inference fixes
    
    * default TimestepBlock without conds
    
    * c_skip=0 by default
    
    * fix bfloat16 to cpu
    
    * use config
    
    * undo temp change
    
    * fix gen_c_embeddings args
    
    * change text encoding
    
    * text encoding
    
    * undo print
    
    * undo .gitignore change
    
    * Allow WuerstchenV3PriorPipeline to use the base DDPM & DDIM schedulers
    
    * use WuerstchenV3Unet in both pipelines
    
    * fix imports
    
    * initial failing tests
    
    * cleanup
    
    * use scheduler.timesterps
    
    * some fixes to the tests, still not fully working
    
    * fix tests
    
    * fix prior tests
    
    * add dropout to the model_kwargs
    
    * more tests passing
    
    * update expected_slice
    
    * initial rename
    
    * rename tests
    
    * rename class names
    
    * make fix-copies
    
    * initial docs
    
    * autodocs
    
    * typos
    
    * fix arg docs
    
    * add text_encoder info
    
    * combined pipeline has optional image arg
    
    * fix documentation
    
    * Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * use self.config
    
    * Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * c_in -> in_channels
    
    * removed kwargs from unet's forward
    
    * Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    
    * remove older callback api
    
    * removed kwargs and fixed decoder guidance > 1
    
    * decoder takes emeds
    
    * check and use image_embeds
    
    * fixed all but one decoder test
    
    * fix decoder tests
    
    * update callback api
    
    * fix some more combined tests
    
    * push combined pipeline
    
    * initial docs
    
    * fix doc_string
    
    * update combined api
    
    * no test_callback_inputs test for combined pipeline
    
    * add optional components
    
    * fix ordering of components
    
    * fix combined tests
    
    * update convert script
    
    * Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    
    * fix imports
    
    * move effnet out of deniosing loop
    
    * prompt_embeds_pooled only when doing guidance
    
    * Fix repeat shape
    
    * move StableCascadeUnet to models/unets/
    
    * more descriptive names
    
    * converted when numpy()
    
    * StableCascadePriorPipelineOutput docs
    
    * rename StableCascadeUNet
    
    * add slow tests
    
    * fix slow tests
    
    * update
    
    * update
    
    * updated model_path
    
    * add args for weights
    
    * set push_to_hub to false
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    * update
    
    ---------
    Co-authored-by: default avatarDominic Rampas <d6582533@gmail.com>
    Co-authored-by: default avatarPablo Pernias <pablo@pernias.com>
    Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
    Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
    Co-authored-by: default avatarYiYi Xu <yixu310@gmail.com>
    Co-authored-by: default avatar99991 <99991@users.noreply.github.com>
    Co-authored-by: default avatarDhruv Nair <dhruv.nair@gmail.com>
    40aa47b9
__init__.py 21.4 KB