Commits · fee93c81eb7c5e9fe1618f858f1e369567170edc · renzhc / diffusers_dcu

"router/vscode:/vscode.git/clone" did not exist on "a9ea60684b6445b2507e147c6aeed0edb0b25eb7"

23 Jan, 2024 5 commits

[Refactor] Update from single file (#6428) · fee93c81

Dhruv Nair authored Jan 23, 2024

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update'

* update

* update

* update

* update

* update

* update

* up

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* up

* update

* update

* update

* update

* update'

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* clean

* update

* update

* clean up

* clean up

* update

* clean

* clean

* update

* updaet

* clean up

* fix docs

* update

* update

* Revert "update"

This reverts commit dbfb8f1ea9c61a2b4e02f926245be2b3d387e577.

* update

* update

* update

* update

* fix controlnet

* fix scheduler

* fix controlnet tests

fee93c81

[Tests] Test for passing local config file to `from_single_file()` (#6638) · 5308cce9
Sayak Paul authored Jan 23, 2024
```
make config file local too.
```
5308cce9
fix dpm related slow test failure (#6680) · 318556b2
YiYi Xu authored Jan 22, 2024
```
fix
Co-authored-by: yiyixuxu <yixu310@gmail,com>
```
318556b2
Standardise outputs for video pipelines (#6626) · 6620eda3
Dhruv Nair authored Jan 23, 2024
```
* update

* update

* update

* update

* update

* update

* update

* clean up

* clean up
```
6620eda3

[Big refactor] move unets to `unets` module

🦋

(#6630) · 1f0705ad

Sayak Paul authored Jan 23, 2024

* move unets to  module 🦋

* parameterize unet-level import.

* fix flax unet2dcondition model import

* models __init__

* mildly depcrecating models.unet_2d_blocks in favor of models.unets.unet_2d_blocks.

* noqa

* correct depcrecation behaviour

* inherit from the actual classes.

* Empty-Commit

* backwards compatibility for unet_2d.py

* backward compatibility for unet_2d_condition

* bc for unet_1d

* bc for unet_1d_blocks

1f0705ad

22 Jan, 2024 5 commits

Update README (#6669) · 5e96333c
M. Tolga Cangöz authored Jan 22, 2024
```
Update number of checkpoints and repositories in README
```
5e96333c
[Diffusion DPO] apply fixes from #6547 (#6668) · da95a28f
Sayak Paul authored Jan 22, 2024
```
apply fixes from #6547
```
da95a28f
Add tearDown method to LoRA tests. (#6660) · d66d554d
Dhruv Nair authored Jan 22, 2024
```
* update

* update
```
d66d554d

add Sa-Solver (#5975) · c7df846d

Junsong Chen authored Jan 22, 2024



* add Sa-Solver



---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: scxue <xueshuchen17@mails.ucas.edu.cn>
Co-authored-by: jschen <chenjunsong4@h-partners.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: yiyixuxu <yixu310@gmail,com>

c7df846d

add padding_mask_crop to all inpaint pipelines (#6360) · 8e7bbfbe

Vinh H. Pham authored Jan 22, 2024



* add padding_mask_crop
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

8e7bbfbe

20 Jan, 2024 1 commit
- fix SDXL-kdiffusion tests (#6647) · e2773c62
  YiYi Xu authored Jan 19, 2024
```
🤞🤞🤞

Co-authored-by: yiyixuxu <yixu310@gmail,com>
```
  e2773c62
19 Jan, 2024 6 commits

fix DPM Scheduler with `use_karras_sigmas` option (#6477) · ac61eefc

YiYi Xu authored Jan 19, 2024



* fix

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

ac61eefc

Fixed the bug related to saving DeepSpeed models. (#6628) · f95615b8

HelloWorldBeginner authored Jan 19, 2024



* Fixed the bug related to saving DeepSpeed models.

* Add information about training SD models using DeepSpeed to the README.

* Apply suggestions from code review

---------
Co-authored-by: mhh001 <mahonghao1@huawei.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

f95615b8

Modularize InstructPix2Pix SDXL inferencing during and after training in examples (#6569) · a9288b49
SangKim authored Jan 19, 2024

a9288b49

refactor: extract init/forward function in UNet2DConditionModel (#6478) · c5441965

elucida authored Jan 19, 2024

* - extract function for stage in UNet2DConditionModel init & forward
- Add new function get_mid_block() to unet_2d_blocks.py

* add type hint to get_mid_block aligned with get_up_block and get_down_block; rename _set_xxx function

* add type hint and  use keyword arguments

* remove `copy from` in versatile diffusion

c5441965

[Community] Experimental AnimateDiff Image to Video (open to improvements) (#6509) · 6382663d

Aryan V S authored Jan 19, 2024



* add animatediff img2vid

* fix

* Update examples/community/README.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* fix code snippet between ip adapter face id and animatediff img2vid

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

6382663d

Update convert_from_ckpt.py / read checkpoint config yaml contents (#6633) · 58b8dce1
spezialspezial authored Jan 19, 2024
```
Update convert_from_ckpt.py / read config yaml contents

Added missing reading of config yaml file contents
```
58b8dce1

18 Jan, 2024 1 commit
- Fix failing tests due to Posix Path (#6627) · a65ca8a0
  Dhruv Nair authored Jan 18, 2024
```
update
```
  a65ca8a0
17 Jan, 2024 5 commits

[docs] Fix missing API function (#6604) · 5ca062e0
Steven Liu authored Jan 17, 2024
```
fix?
```
5ca062e0
[bug fix] advanced dreambooth lora sdxl - fixes bugs described in #6486 (#6599) · 619e3ab6
Linoy Tsaban authored Jan 17, 2024
```
* fixes bugs:
1. redundant retraction
2. param clone
3. stopping optimization of text encoder params

* param upscaling

* style
```
619e3ab6
Update pr_test_peft_backend.yml to use 1 process for testing (#6613) · 9e2804f7
Patrick von Platen authored Jan 17, 2024

9e2804f7

FreeInit (#6315) · 9112028e

Aryan V S authored Jan 17, 2024



* freeinit

* update freeinit implementation based on review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com>

* fix

* another fix

* refactor

* fix timesteps missing bug

* apply suggestions from review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com>

* add test for freeinit

* apply suggestions from review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com>

* refactor

* fix test

* fix tensor not on same device

* update

* remove return_intermediate_results

* fix broken freeinit test

* update animatediff docs

---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

9112028e

Fixes torch.compile() compatible training (#6589) · dce06680
Steve Rhoades authored Jan 16, 2024
```
resolve conflicts
```
dce06680

16 Jan, 2024 13 commits

Update installation.md (#6438) · dd631683
Bhavay Malhotra authored Jan 17, 2024
```
* Update installation.md

* Update installation.md

* Update installation.md
```
dd631683

[Fix] Multiple image conditionings in a single batch for... · 1040dfd9

Celestial Phineas authored Jan 17, 2024


[Fix] Multiple image conditionings in a single batch for `StableDiffusionControlNetPipeline` (#6334)

* [Fix] Multiple image conditionings in a single batch for `StableDiffusionControlNetPipeline`.

* Refactor `check_inputs` in `StableDiffusionControlNetPipeline` to avoid redundant codes.

* Make the behavior of MultiControlNetModel to be the same to the original ControlNetModel

* Keep the code change minimum for nested list support

* Add fast test `test_inference_nested_image_input`

* Remove redundant check for nested image condition in `check_inputs`

Remove `len(image) == len(prompt)` check out of `check_image()`
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Better `ValueError` message for incompatible nested image list size
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Fix syntax error in `check_inputs`

* Remove warning message for multi-ControlNets with multiple prompts

* Fix a typo in test_controlnet.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Add test case for multiple prompts, single image conditioning in `StableDiffusionMultiControlNetPipelineFastTests`

* Improved `ValueError` message for nested `controlnet_conditioning_scale`

* Documenting the behavior of image list as `StableDiffusionControlNetPipeline` input

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

1040dfd9

remove omegaconf from the residues 👋 (#6600) · 49a4b377
Sayak Paul authored Jan 16, 2024
```
remove omegaconf 👋
```
49a4b377
Change in ip-adapter docs. CLIPVisionModelWithProjection should be im… (#6597) · dff35a86
JuanCarlosPi authored Jan 16, 2024
```
Change in ip-adapter docs. CLIPVisionModelWithProjection should be imported from transformers, not diffusers
```
dff35a86
[SVD] Return np.ndarray when output_type="np" (#6507) · 8842bcad
Yondon Fu authored Jan 16, 2024
```
[SVD] Fix output_type="np"
```
8842bcad

Fixes training resuming: Advanced Dreambooth LoRa Training (#6566) · 181280ba

Steve Rhoades authored Jan 16, 2024

* Fixes #6418 Advanced Dreambooth LoRa Training

* change order of import to fix nit

* fix nit, use cast_training_params

* remove torch.compile fix, will move to a new PR

* remove unnecessary import

181280ba

Use of Posix to better support Windows compatibility in testing_utils (#6587) · 53f498d2
Charchit Sharma authored Jan 16, 2024
```
* changes in utils

* removed loc
```
53f498d2
change to posix for better Windows support for lora loaders (#6590) · 99086091
Charchit Sharma authored Jan 16, 2024
```
* posix lora

* changes and style fix
```
99086091

Fix path generation in IP Adapter (#6564) · 23eed397

Fabio Rigano authored Jan 16, 2024



* Fix path generation on Windows

* Update set_default_attn_processors

* Use pathlib

* Fix quality

* Fix copy

* Revert changes in set_default_attn_processors

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

23eed397

update slow test for SDXL k-diffusion pipeline (#6588) · fefed445
YiYi Xu authored Jan 15, 2024
```
update expected slice
```
fefed445

🐛

fix ip-adapter controlnet img2img missing code (#6528) · 814f56d2

Dong authored Jan 16, 2024

* 🐛 fix ip-adapter controlnet img2img missing code

* 📝 edit test

* 📝 edit test

* 📝 run make style and quality

* 🎨 remove slow tests

814f56d2

Enable image resizing to adjust its height and width in... · 96d6e165

SangKim authored Jan 16, 2024

Enable image resizing to adjust its height and width in StableDiffusionXLInstructPix2PixPipeline (#6581)

* Enable image resizing to adjust its height and width in StableDiffusionXLInstructPix2PixPipeline

* Ensure that validation is performed at every 'validation_step', not at every step

96d6e165

[training] fix training resuming problem for fp16 (SD LoRA DreamBooth) (#6554) · c11de135
Aryan V S authored Jan 16, 2024
```
* fix training resume

* update

* update
```
c11de135

15 Jan, 2024 4 commits

[Docs] Fix controlnet indent (#6578) · 357855f8
Patrick von Platen authored Jan 15, 2024

357855f8

[Community Pipeline] IPAdapter FaceID (#6276) · f825221b

Fabio Rigano authored Jan 15, 2024



* Add support for IPAdapter FaceID

* Add docs

* Move subfolder to kwargs

* Fix quality

* Fix image encoder loading

* Fix loading + add test

* Move to community folder

* Fix style

* Revert constant update

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

f825221b

[AnimateDiff+Controlnet] Fix multicontrolnet support (#6551) · 119d734f
Aryan V S authored Jan 15, 2024
```
* fix multicontrolnet support

* update README with multicontrolnet example
```
119d734f

[OmegaConf] replace it with `yaml` (#6488) · cb4b3f0b

Sayak Paul authored Jan 15, 2024

* remove omegaconf from convert_from_ckpt.

* remove from single_file.

* change to string based ubscription.

* style

* okay

* fix: vae_param

* no . indexing.

* style

* style

* turn getattrs into explicit if/else

* style

* propagate changes to ldm_uncond.

* propagate to gligen

* propagate to if.

* fix: quotes.

* propagate to audioldm.

* propagate to audioldm2

* propagate to musicldm.

* propagate to vq_diffusion

* propagate to zero123.

* remove omegaconf from diffusers codebase.

cb4b3f0b