GitLab

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

RFInversionFluxPipeline, small fix for enable_model_cpu_offload & enable_sequential_cpu_offload compatibility (#10480)

RFInversionFluxPipeline.encode_image, device fix

Use self._execution_device instead of self.device when selecting
a device for the input image tensor.

This allows for compatibility with enable_model_cpu_offload &
enable_sequential_cpu_offload
Co-authored-by: Teriks <Teriks@users.noreply.github.com>
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>

Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.4 to 3.1.5.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.1.4...3.1.5

)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* update

* update

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* fix make copies

* update

* add relevant markers to the integration test suite.

* add copied.

* fox-copies

* temporarily add print.

* directly place on CUDA as CPU isn't that big on the CIO.

* fixes to fuse_lora, aryan was right.

* fixes

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* make base code changes referred from train_instructpix2pix script in examples

* change code to use PEFT as discussed in issue 10062

* update README training command

* update README training command

* refactor variable name and freezing unet

* Update examples/research_projects/instructpix2pix_lora/train_instruct_pix2pix_lora.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update README installation instructions.

* cleanup code using make style and quality

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* qol improvements to the Flux script.

* propagate the dataloader changes.

fix

Regarding the RunwayML path for V1.5 did change to stable-diffusion-v1-5/[stable-diffusion-v1-5/ stable-diffusion-inpainting] (#10476)

* Update pipeline_controlnet.py

* Update pipeline_controlnet_img2img.py

runwayml Take-down so change all from to this
stable-diffusion-v1-5/stable-diffusion-v1-5

* Update pipeline_controlnet_inpaint.py

* runwayml take-down make change to sd-legacy

* runwayml take-down make change to sd-legacy

* runwayml take-down make change to sd-legacy

* runwayml take-down make change to sd-legacy

* Update convert_blipdiffusion_to_diffusers.py

style change

* Add torch_xla and from_single_file to instruct-pix2pix

* StableDiffusionInstructPix2PixPipelineSingleFileSlowTests

* StableDiffusionInstructPix2PixPipelineSingleFileSlowTests

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* fix

* add coauthor
Co-Authored-By: Nerogar <nerogar@arcor.de>

---------
Co-authored-by: Nerogar <nerogar@arcor.de>

* fix: lora unloading when using expanded Flux LoRAs.

* fix argument name.
Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* docs.

---------
Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* LEditsPP - examples, check height/width, add tiling/slicing

* make style

* Fix broken links in docs

* fix parenthesis

fix

`lora_bias` PEFT version check in `unet.load_attn_procs` path

add slow and nightly markers to sd3 lora integation.

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

Update rerender_a_video.py

* Update rerender_a_video.py

* Update rerender_a_video.py

* make style

---------
Co-authored-by: hlky <hlky@hlky.ac>

Fix AutoPipeline `from_pipe` where source pipeline is missing target pipeline's optional components (#10400)

* Optional components in AutoPipeline

* missing_modules

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

Enable VAE hash to be able to change with args change. If not, train_dataset_with_embeddiings may have row number inconsistency with train_dataset_with_vae.
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>

fix links
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

update

fix attribute adjustment for ltx.

* IP-Adapter support for `StableDiffusion3ControlNetPipeline`

* Update src/diffusers/pipelines/controlnet_sd3/pipeline_stable_diffusion_3_controlnet.py
Co-authored-by: hlky <hlky@hlky.ac>

---------
Co-authored-by: hlky <hlky@hlky.ac>

fix pe bug for Sana
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* check for base_layer key in transformer state dict

* test_lora_expansion_works_for_absent_keys

* check

* Update tests/lora/test_lora_layers_flux.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* check

* test_lora_expansion_works_for_absent_keys/test_lora_expansion_works_for_extra_keys

* absent->extra

---------
Co-authored-by: hlky <hlky@hlky.ac>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

Add correct number of channels when resuming from checkpoint for Flux Control LoRa training (#10422)

* Add correct number of channels when resuming from checkpoint

* Fix Formatting

* update

* update

* feedback

* fix videos

* use previous checkpoint

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* quantization

* add other vid models

* typo

* more pipelines

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update pix2pix.md

fix hyperlink error

* fix md link typos

* fix md typo - remove ".md" at the end of links

* [Fix] Broken links in hunyuan docs (#10402)

* fix-hunyuan-broken-links

* [Fix] docs broken links hunyuan

* [training] add ds support to lora sd3. (#10378)

* add ds support to lora sd3.
Co-authored-by: leisuzz <jiangshuonb@gmail.com>

* style.

---------
Co-authored-by: leisuzz <jiangshuonb@gmail.com>
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>

* fix md typo - remove ".md" at the end of links

* fix md link typos

* fix md typo - remove ".md" at the end of links

---------
Co-authored-by: SahilCarterr <110806554+SahilCarterr@users.noreply.github.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: leisuzz <jiangshuonb@gmail.com>
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>

* add ds support to lora sd3.
Co-authored-by: leisuzz <jiangshuonb@gmail.com>

* style.

---------
Co-authored-by: leisuzz <jiangshuonb@gmail.com>
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>

* fix-hunyuan-broken-links

* [Fix] docs broken links hunyuan

SD3 pipelines hasattr

[Add] torch_xla support in pipeline_sana.py

* Add torch_xla support to pipeline_aura_flow.py

* make style

---------
Co-authored-by: hlky <hlky@hlky.ac>

* feat: support unload_lora_weights() for Flux Control.

* tighten test

* minor

* updates

* meta device fixes.