GitLab

* Update textual_inversion.py

* Apply suggestions from code review

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update examples/textual_inversion/textual_inversion.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update textual_inversion.py

* styling

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* standardize model card

* fix tags

* correct import styling and update tags

* run make style and make quality

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Fix words

* Fix

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Bugfix: correct import for diffusers

* Fix: Prompt2Prompt example

* Format style

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* fix bug in micro-conditioning of class images

* fix bug in micro-conditioning of class images

* style

* Updated lora inference instructions

* Update examples/dreambooth/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update README.md

* Update README.md

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

fixed type annotations
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

standardize model card template t21-adapter-sdxl

* standardize model card template t2i-lora-sdxl

* type annotations

standardize model card template t2i-sdxl

standardize model card t2i-lora

* standardize model card

* fix base_model

* post release

* style

* Empty-Commit

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

[FIX] IMPORTANT: rgb normalization

* controlnet

* style

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

controlnet-sdxl

* controlnet-flax

* style

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Fix Compatibility Issues in stable_diffusion_xl_reference.py

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

Co-authored-by: wangshaoxiao <wangshaoxiao@xiaomi.com>

Remove <cat-toy> validation prompt from examples/textual_inversion/textual_inversion_sdxl.py (#6877)

Remove <cat-toy> validation prompt from textual_inversion_sdxl.py

The `<cat-toy>` validation prompt is a default choice for the example task in the README. But no other part of `textual_inversion_sdxl.py` references the cat toy and `textual_inversion.py` has a default validation prompt of `None` as well.

So bring `textual_inversion_sdxl.py` in line with `textual_inversion.py` and change default validation prompt to `None`

change to 2024

* Fix: training resume from fp16 for lcm distill lora sdxl

* Fix coding quality - run linter

* Fix 1 - shift mixed precision cast before optimizer

* Fix 2 - State dict errors by removing load_lora_into_unet

* Update train_lcm_distill_lora_sdxl.py - Revert default cache dir to None

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* feat: standarize model card creation for dreambooth training.

* correct 'inference

* remove comments.

* take component out of kwargs

* style

* add: card template to have a leaner description.

* widget support.

* propagate changes to train_dreambooth_lora

* propagate changes to custom diffusion

* make widget properly type-annotated

fix sd reference community ppeline
Co-authored-by: yiyixuxu <yixu310@gmail,com>

* add micro conditioning

* remove redundant lines

* style

* fix missing 's'

* fix missing shape bug due to missing RGB if statement

* remove redundant if, change arg order

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* add noise_offset param

* micro conditioning - wip

* image processing adjusted and moved to support micro conditioning

* change time ids to be computed inside train loop

* change time ids to be computed inside train loop

* change time ids to be computed inside train loop

* time ids shape fix

* move token replacement of validation prompt to the same section of instance prompt and class prompt

* add offset noise to sd15 advanced script

* fix token loading during validation

* fix token loading during validation in sdxl script

* a little clean

* style

* a little clean

* style

* sdxl script - a little clean + minor path fix

sd 1.5 script - change default resolution value

* ad 1.5 script - minor path fix

* fix missing comma in code example in model card

* clean up commented lines

* style

* remove time ids computed outside training loop - no longer used now that we utilize micro-conditioning, as all time ids are now computed inside the training loop

* style

* [WIP] - added draft readme, building off of examples/dreambooth/README.md

* readme

* readme

* readme

* readme

* readme

* readme

* readme

* readme

* removed --crops_coords_top_left from CLI args

* style

* fix missing shape bug due to missing RGB if statement

* add blog mention at the start of the reamde as well

* Update examples/advanced_diffusion_training/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* change note to render nicely as well

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

Update train_dreambooth_lora_sdxl.py

add ipo and hinge loss to dpo trainer

* Update train_diffusion_dpo.py

Address #6702

* Update train_diffusion_dpo_sdxl.py

* Empty-Commit

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Fix mixed precision fine-tuning for text-to-image-lora-sdxl example.

* fix text_encoder_two bug.

---------
Co-authored-by: Sajad Norouzi <sajadn@dev-dsk-sajadn-2a-87239470.us-west-2.amazon.com>

* fix minsnr implementation for v-prediction case

* format code

* always compute snr when snr_gamma is specified

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Add UFOGenScheduler with diffusers imports changed from relative to absolute.

* make style

* Add community README entry for UFOGenScheduler.

* initial commit for unconditional/class-conditional consistency training script

* make style

* Add entry for consistency training script in community README.

* Move consistency training script from community to research_projects/consistency_training

* Add requirements.txt and README to research_projects/consistency_training directory.

* Manually revert community README changes for consistency training.

* Fix path to script after moving script to research projects.

* Add option to load U-Net weights from pretrained model.

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* sd1.5 support in separate script

A quick adaptation to support people interested in using this method on 1.5 models.

* sd15 prompt text encoding and unet conversions

as per @linoytsaban 's recommendations. Testing would be appreciated,

* Readability and quality improvements

Removed some mentions of SDXL, and some arguments that don't apply to sd 1.5, and cleaned up some comments.

* make style/quality commands

* tracker rename and run-it doc

* Update examples/advanced_diffusion_training/train_dreambooth_lora_sd15_advanced.py

* Update examples/advanced_diffusion_training/train_dreambooth_lora_sd15_advanced.py

---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>