GitLab

* SD3 training fixes
Co-authored-by: bghira <59658056+bghira@users.noreply.github.com>

* rewrite noise addition part to respect the eqn.

* styler

* Update examples/dreambooth/README_sd3.md
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com>

---------
Co-authored-by: bghira <59658056+bghira@users.noreply.github.com>
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com>

Mention model_info.id instead of model_info.modelId

* 2d rotary pos emb dim

* make style

---------
Co-authored-by: haofanwang <haofanwang.ai@gmail.com>

* fix loop bug in SlicedAttnProcessor


---------
Co-authored-by: neoshang <neoshang@tencent.com>

* initial commit

* apply suggestion to sdxl pipelines

* apply fix to sd pipelines

* update

* update

* update

* update

* update

update

* remove resume_download

* fix: _fetch_index_file call.

* remove resume_download from docs.

add disable forward chunking to SD3 transformer.

* add pipeline docs for latte

* add inference time to latte docs

* apply review suggestions

* Fix multi-gpu case

* Prefer previously created `unwrap_model()` function

For `torch.compile()` generalizability

* `chore: update unwrap_model() function to use accelerator.unwrap_model()`

* Add AuraFlowPipeline and KolorsPipeline to auto map

Just T2I. Validated using `quickdif`

* Add Kolors I2I and SD3 Inpaint auto maps

* style

---------
Co-authored-by: yiyixuxu <yixu310@gmail.com>

* allow auraflow latest to be torch compile compatible.

* default to 1024 1024.

fix: shard loading and saving when variant is provided.

* Add the SDE variant of DPM-Solver and DPM-Solver++ to DPM Single Step


---------
Co-authored-by: cmdr2 <secondary.cmdr2@gmail.com>

include python3.10 dev and solve header missing problem

* fix typo in pag tests

* fix typo

* add pag support sd15 controlnet

* fix quality import

* remove unecessary import

* remove if state

* fix tests

* remove useless function

* add sd1.5 controlnet pag docs

---------
Co-authored-by: anhnct8 <anhnct8@fpt.com>

* add animatediff_ipex community pipeline

* address the 1st round review comments

* add pipeline documentation.

* add api spec for pipeline

* model documentation

* model spec

* update

* update

* update

* update

update

* add lavender flow transformer

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* initial draft

* add Latte to diffusers

* remove print

* remove print

* remove print

* remove unuse codes

* remove layer_norm_latte and add a flag

* remove layer_norm_latte and add a flag

* update latte_pipeline

* update latte_pipeline

* remove unuse squeeze

* add norm_hidden_states.ndim == 2: # for Latte

* fixed test latte pipeline bugs

* fixed test latte pipeline bugs

* delete sh

* add doc for latte

* add licensing

* Move Transformer3DModelOutput to modeling_outputs

* give a default value to sample_size

* remove the einops dependency

* change norm2 for latte

* modify pipeline of latte

* update test for Latte

* modify some codes for latte

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* modify for Latte pipeline

* video_length -> num_frames; update prepare_latents copied from

* make fix-copies

* make style

* typo: videe -> video

* update

* modify for Latte pipeline

* modify latte pipeline

* modify latte pipeline

* modify latte pipeline

* modify latte pipeline

* modify for Latte pipeline

* Delete .vscode directory

* make style

* make fix-copies

* add latte transformer 3d to docs _toctree.yml

* update example

* reduce frames for test

* fixed bug of _text_preprocessing

* set num frame to 1 for testing

* remove unuse print

* add text = self._clean_caption(text) again

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Aryan <contact.aryanvs@gmail.com>
Co-authored-by: Aryan <aryan@huggingface.co>

* Reformat docstring for `get_timestep_embedding`


---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* fix

* fix

* ugly

* okay

* fix more

* fix oops

* Add pipeline_stable_diffusion_3_inpaint


---------
Co-authored-by: Xu Cao <xucao2@jrehg-work-01.cs.illinois.edu>
Co-authored-by: IrohXu <irohcao@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Remove unused line


---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Fix static typing and doc typos

* Fix more same type hint typos with make fix-copies

---------
Co-authored-by: zhuole1025 <zhuole1025@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* fix load sharded checkpoints from subfolder{

* style

* os.path.join

* add a small test

---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com>

* Improve trainer model cards

* Update train_dreambooth_sd3.py

* Update train_dreambooth_lora_sd3.py

* add link to adapters loading doc

* Update train_dreambooth_lora_sd3.py

---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>

* update

* update

* update

* update

* update

* update

* update

* Add vae_roundtrip.py example

* Add cuda support to vae_roundtrip

* Move vae_roundtrip.py into research_projects/vae

* Fix channel scaling in vae roundrip and also support taesd.

* Apply ruff --fix for CI gatekeep check

---------
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com>

fix sharding tests