GitLab

* move model helper function in pipeline to EfficiencyMixin

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* DPMMultistep rescale_betas_zero_snr

* DPM upcast samples in step()

* DPM rescale_betas_zero_snr UT

* DPMSolverMulti move sample upcast after model convert

Avoids having to re-use the dtype.

* Add a newline for Ruff

* add DPM scheduler with EDM formulation

* set sigmas in init

* add _compute_sigmas

* Apply suggestions from code review
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* address some review comments

* up,

* add tests

---------
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* Add EDMEulerScheduler

* address review comments

* fix import

* fix test

* add tests

* add co-author

Co-authored-by:  @dg845 dgu8957@gmail.com

* denormalize latents with the mean and std if available

* fix denormalize

* add latent mean and std in vae config

* address sayak's comment

* pass revision in the loading_kwarhs.

* remove revision from load_sub_model.

* copy the state dict in load lora weights

* fixup

* Make LoRACompatibleConv padding_mode work.

* Format code style.

* add fast test

* Update src/diffusers/models/lora.py

Simplify the code by patrickvonplaten.
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* code refactor

* apply patrickvonplaten suggestion to simplify the code.

* rm test_lora_layers_old_backend.py and add test case in test_lora_layers_peft.py

* update test case.

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* pass linear projection parameter to mid block

* add cond_proj_dim to motion UNet

* run style and quality checks

* Fix IPAdapterAttnProcessor

* Fix batch_to_head_dim and revert reshape

* fix denoising start

* fix tests

* remove debug

* begin IPAdapterTesterMixin



---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* add

* remove copied from

---------
Co-authored-by: ultranity <1095429904@qq.com>
Co-authored-by: yiyixuxu <yixu310@gmail,com>

* allow passing tokenizer & text_encoder to unload_textual_inversion


---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Fabio Rigano <fabio2rigano@gmail.com>
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>

* fix doc

* remove use_safetensors from signature

* more

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>

update

* support ip adapter loading

* fix style

* add ip-adapter support

* support ip image embeds

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

fix
Co-authored-by: yiyixuxu <yixu310@gmail,com>

* Add attention masking to attn processors

* Update tensor conversion

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* make text encoder component truly optional.

* more fixes

* Apply suggestions from code review
Co-authored-by: YiYi Xu <yixu310@gmail.com>

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

Fixed deprecation warning for torch.utils._pytree._register_pytree_node in PyTorch 2.2
Co-authored-by: Yinghua <yzho0423@uni.sydney.edu.au>

* fix

* update docstring

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>

* Fixed typos in __init__ and in forward of Unet3DConditionModel

* Resolving conflicts

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

copy docstring for `strength` from  stablediffusion img2img pipeline to controlnet img2img pipelines

* Fix words

* Fix

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* feat: allow low_cpu_mem_usage in ip adapter loading

* reduce the number of device placements.

* documentation.

* throw low_cpu_mem_usage warning only once from the main entry point.

* use cases

* first draft

* fix image links

* lcm-lora

* feedback

* review

* feedback

* feedback

* use load_model_into_meta in single file utils

* propagate to autoencoder and controlnet.

* correct class name access behaviour.

* remove torch_dtype from load_model_into_meta; seems unncessary

* remove incorrect kwarg

* style to avoid extra unnecessary line breaks

* update

* update

* update

[DPMSolverSinglestepScheduler] correct `get_order_list` for `solver_order=2`and `lower_order_final=True`  (#6953)

* add

* change default

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>

* update

fix

* fix: bias loading bug

* fixes for SDXL

* apply changes to the conversion script to match single_file_utils.py

* do transpose to match the single file loading logic.

* update

* update

* update

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>