Commits · b37dc3b3cdda401ee370a5e2a8d2e27a016078ac · chenpangpang / diffusers

"...git@developer.sourcefind.cn:chenpangpang/open-webui.git" did not exist on "1f8d08eaa2ef2998b05890f5a13522e9a3602b5b"

25 Jul, 2023 15 commits

Fix all missing optional import statements from pipeline folders (#4272) · b37dc3b3
Patrick von Platen authored Jul 26, 2023
```
* fix circular import

* fix imports when watermark not specified

* fix all pipelines
```
b37dc3b3

Load Kohya-ss style LoRAs with auxilary states (#4147) · ff8f5808

Batuhan Taskaya authored Jul 26, 2023



* Support to load Kohya-ss style LoRA file format (without restrictions)
Co-Authored-By: Takuma Mori <takuma104@gmail.com>
Co-Authored-By: Sayak Paul <spsayakpaul@gmail.com>

* tmp: add sdxl to mlp_modules

---------
Co-authored-by: Takuma Mori <takuma104@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

ff8f5808

[SDXL DreamBooth LoRA] multiple fixes (#4262) · 161449d5

Sayak Paul authored Jul 26, 2023

* add automatic licensing.

* debugging

* debugging

* more debugging

* more debugging.

* run make fix-copies.

* change to default tracker.

161449d5

[docs] Fix image in SDXL docs (#4267) · 34abee09
Steven Liu authored Jul 25, 2023
```
fix image link
```
34abee09

[SDXL and IP2P]: instruction pix2pix XL training and pipeline (#4079) · 428dbfec

Harutatsu Akiyama authored Jul 25, 2023



* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* [Community] Implementation of the IADB community pipeline (#3996)

* community pipeline: implementation of iadb

* iadb.py: reformat using black

* iadb.py: linting update

* add kandinsky to readme table (#4081)
Co-authored-by: yiyixuxu <yixu310@gmail,com>

* [From Single File] Force accelerate to be installed (#4078)

force accelerate to be installed

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Clean up IP2P SDXL code

* Clean up IP2P SDXL code

* [IP2P and SDXL] clean up code

* [IP2P and SDXL] clean up code

* [IP2P and SDXL] clean up code

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Add README_SDXL

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Fix the copy problems

* [IP2P SDXL] Add license

* [IP2P SDXL] Add license

* [IP2P SDXL] Add license

* [IP2P SDXL] Address code reivew for selecting VAE andd others

* [IP2P SDXL] Update README_sdxl

* [IP2P SDXL] Update __init__

* [IP2P SDXL] Update dummy_torch_and_transformers_and_invisible_watermark_objects

* address patrick's comments and some additions to readmes.

---------
Co-authored-by: Harutatsu Akiyama <kf.zy.qin@gmail.com>
Co-authored-by: Thomas Chambon <36728882+tchambon@users.noreply.github.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

428dbfec

Model path for sdxl wrong in dreambooth README (#4261) · 4e2a0218
Ragnar Rova authored Jul 25, 2023

4e2a0218
[from_single_file] Fix circular import (#4259) · ebfe3431
Patrick von Platen authored Jul 25, 2023
```
* up

* finish

* fix final
```
ebfe3431
Update README_sdxl.md to change the note on default hyperparameters (#4258) · 5ef6b8fa
Sayak Paul authored Jul 25, 2023

5ef6b8fa

[draft v2] AutoPipeline (#4138) · c11d11d6

YiYi Xu authored Jul 25, 2023



* initial

* style

* from ...pipelines -> from ..pipeline_util

* make style

* fix-copies

* fix value_guided_sampling oops

* style

* add test

* Show failing test

* update from_pipe

* fix

* add controlnet, additional test and register unused original config

* update for controlnet

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* store unused config as private attribute and pass if can

* add doc

* kandinsky inpaint pipeline does not work with decoder checkpoint

* update doc

* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* style

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* fix

* Apply suggestions from code review

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

c11d11d6

[SDXL] Improve docs (#4196) · d74561da

Patrick von Platen authored Jul 25, 2023



* Improve docs

* Correct docs

* Add better example inpaint

* make style

* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* fix

---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

d74561da

[From Single File] Allow vae to be loaded (#4242) · a0422ed0
Patrick von Platen authored Jul 25, 2023
```
* Allow vae to be loaded

* up
```
a0422ed0
do not pass list to accelerator.init_trackers (#4248) · 3dd33937
Will Berman authored Jul 24, 2023

3dd33937

Resolve bf16 error as mentioned in this... · 5652c43f

nupurkmr9 authored Jul 24, 2023

Resolve bf16 error as mentioned in this [issue](https://github.com/huggingface/diffusers/issues/4139#issuecomment-1639977304) (#4214)

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

5652c43f

[SDXL DreamBooth LoRA] add support for text encoder fine-tuning (#4097) · 365e8461

Sayak Paul authored Jul 25, 2023



* Allow low precision sd xl

* finish

* finish

* feat: initial draft for supporting text encoder lora finetuning for SDXL DreamBooth

* fix: variable assignments.

* add: autocast block.

* add debugging

* vae dtype hell

* fix: vae dtype hell.

* fix: vae dtype hell 3.

* clean up

* lora text encoder loader.

* fix: unwrapping models.

* add: tests.

* docs.

* handle unexpected keys.

* fix vae dtype in the final inference.

* fix scope problem.

* fix: save_model_card args.

* initialize: prefix to None.

* fix: dtype issues.

* apply gixes.

* debgging.

* debugging

* debugging

* debugging

* debugging

* debugging

* add: fast tests.

* pre-tokenize.

* address: will's comments.

* fix: loader and tests.

* fix: dataloader.

* simplify dataloader.

* length.

* simplification.

* make style && make quality

* simplify state_dict munging

* fix: tests.

* fix: state_dict packing.

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

365e8461

[ControlNet SDXL training] fixes in the training script (#4223) · fed12376

Sayak Paul authored Jul 25, 2023

* fix: #4206

* add: sdxl controlnet training smoketest.

* remove unnecessary token inits.

* add: licensing to model card.

* include SDXL licensing in the model card and make public visibility default

* debugging

* debugging

* disable local file download.

* fix: training test.

* fix: ckpt prefix.

fed12376

24 Jul, 2023 11 commits

[Docs] Fix from pretrained docs (#4240) · 95b7de88
Patrick von Platen authored Jul 24, 2023
```
* [Docs] Fix from pretrained docs

* [Docs] Fix from pretrained docs
```
95b7de88
docs: Add missing import statement in textual_inversion inference example (#4227) · cbb1ead6
Apoorva Kulkarni authored Jul 24, 2023
```
docs: Add missing import statement in textual_inversion inference instructions
```
cbb1ead6
[docs] Other modalities (#4205) · 5470a4fc
Steven Liu authored Jul 24, 2023
```
remove coming soon, rl pipeline
```
5470a4fc

Allow specifying denoising_start and denoising_end as integers representing... · e98fabc5

39th president of the United States, probably authored Jul 24, 2023

Allow specifying denoising_start and denoising_end as integers representing the discrete timesteps, fixing the XL ensemble not working for many schedulers (#4115)

* Fix the XL ensemble not working for any kerras scheduler sigmas and having an off by one bug

* Update src/diffusers/pipelines/stable_diffusion_xl/pipeline_stable_diffusion_xl.py

* make sytle

---------

Co-authored-by: Jimmy <39@🇺🇸

.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

e98fabc5

[docs] Changed path for ControlNet in docs (#4215) · fa356bd4
Cris authored Jul 24, 2023
```
docs: changed path for control net
```
fa356bd4
[SD-XL] Fix sdxl controlnet inference (#4238) · 3ba36f97
Patrick von Platen authored Jul 24, 2023
```
* Fix controlnet xl inference

* correct some sd xl control inference
```
3ba36f97
[SDXL] Fix sd xl encode prompt (#4237) · b288684d
Patrick von Platen authored Jul 24, 2023
```
* [SDXL] Fix sd xl encode prompt

* add tests
```
b288684d
Raise initial HTTPError if pipeline is not cached locally (#4230) · 06eda5b2
Lucain authored Jul 24, 2023
```
* Raise initial HTTPError if pipeline is not cached locally

* make style
```
06eda5b2

fix a bug of `prompt embeds` in sdxl (#4099) · 8e5921ca

Hu Ye authored Jul 24, 2023



* fix bug in sdxl

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl_inpaint.py

* Update pipeline_stable_diffusion_xl.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl_inpaint.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_controlnet_sd_xl.py

* Update pipeline_controlnet_sd_xl.py

* Update pipeline_stable_diffusion_xl.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl_inpaint.py

* Update test_stable_diffusion_xl.py

* Update test_stable_diffusion_xl.py

* Update test_stable_diffusion_xl.py

add test on prompt_embeds

* add test on prompt_embeds

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

8e5921ca

fix no CFG for kandinsky pipelines (#4193) · 8e8954bd

YiYi Xu authored Jul 23, 2023



* fix bug when no cfg

* style

* fix no cfg for shap-e and cycle

* style

* fix no cfg for sdxl

* fix copies

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>

8e8954bd

[fix] `network_alpha` when loading unet lora from old format (#4221) · 09fab561
Jackmin801 authored Jul 24, 2023
```
fix: missed network_alpha when loading lora from old format
```
09fab561

21 Jul, 2023 11 commits

docs: Typo in dreambooth example README.md (#4203) · 2e53936c
Apoorva Kulkarni authored Jul 21, 2023
```
fix: Typo in dreambooth example README.md
```
2e53936c

[docs] Clean up pipeline apis (#3905) · a69754bb

Steven Liu authored Jul 21, 2023

* start with stable diffusion

* fix

* finish stable diffusion pipelines

* fix path to pipeline output

* fix flax paths

* fix copies

* add up to score sde ve

* finish first pass of pipelines

* fix copies

* second review

* align doc titles

* more review fixes

* final review

a69754bb

📄

Renamed File for Better Understanding (#4056) · bcc570b9

Kadir Nar authored Jul 21, 2023

* 📄 Renamed File for Better Understanding

Renamed the 'rl' file to 'run_locomotion'. This change was made to improve the clarity and readability of the codebase. The 'rl' name was ambiguous, and 'run_locomotion' provides a more clear description of the file's purpose.

Thanks 🙌

* 📁

 [Docs] Renamed Directory for Better Clarity

Renamed the 'rl' directory to 'reinforcement_learning'. This change provides a clearer understanding of the directory's purpose and its contents.

* Update examples/reinforcement_learning/README.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* 📝

 Update README

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

bcc570b9

[SDXL ControlNet Training] Follow-up fixes (#4188) · 4dcab922
Sayak Paul authored Jul 21, 2023
```
* hash computation. thanks to @lhoestq

* disable dtype casting.

* remove comments.
```
4dcab922

Allow passing different prompts to each `text_encoder` on `stable_diffusion_xl` pipelines (#4156) · aed30dff

apolinário authored Jul 21, 2023



* sdxl prompt2

* Improve checks

* doc linting

* whoops

* remove cat

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Add other pipelines and tests

* Add multi-prompting to docs

* doc and copies check

* Fix copied froms

* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Bring back the original code for unrelated files

* Fix tests

* Fix img2img

* Fix all

* fix

---------
Co-authored-by: multimodalart <joaopaulo.passos+multimodal@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

aed30dff

make enable_sequential_cpu_offload more generic for third-party devices (#4191) · e2bbaa4f
statelesshz authored Jul 21, 2023
```
* make enable_sequential_cpu_offload more generic for third-party devices

* make style
```
e2bbaa4f
[Safetensors] make safetensors a required dep (#4177) · 1e853e24
Patrick von Platen authored Jul 21, 2023

1e853e24
Fix unloading of LoRAs when xformers attention procs are in use (#4179) · ad787082
Batuhan Taskaya authored Jul 21, 2023

ad787082
remove bentoml doc in favor of blogpost (#4182) · 7a47df22
Will Berman authored Jul 20, 2023

7a47df22
[ControlNet Training] Remove safety from controlnet (#4180) · d620070b
Patrick von Platen authored Jul 21, 2023
```
Remove safety from controlnet
```
d620070b
[From single file] Make sure that controlnet stays False for from_single_file (#4181) · b7a6e34c
Patrick von Platen authored Jul 21, 2023
```
* fix from signle file

* Make sure converison always works with safetensors
```
b7a6e34c

20 Jul, 2023 3 commits

Shap-E: add support for mesh output (#4062) · 47b33464

YiYi Xu authored Jul 20, 2023



* add output_type=mesh

* update img2img

* make style

* add doc

* make style

* Apply suggestions from code review
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* add docstring for output_type

* add a section in doc about hub mesh visualization/ rotation

* update conversion script so default background is white

* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update src/diffusers/pipelines/shap_e/pipeline_shap_e_img2img.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* renderer -> shap_e_renderer

* img2img renderer -> shap_e_renderer

* fix tests

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

47b33464

Asymmetric vqgan (#3956) · 07f1fbb1

Ruslan Vorovchenko authored Jul 20, 2023



* added AsymmetricAutoencoderKL

* fixed copies+dummy

* added script to convert original asymmetric vqgan

* added docs

* updated docs

* fixed style

* fixes, added tests

* update doc

* fixed doc

* fixed tests

* naming
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* naming
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* udpated code example

* updated doc

* comments fixes

* added docstring
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* comments fixes

* added inpaint pipeline tests

* comment suggestion: delete method

* yet another fixes

---------
Co-authored-by: Ruslan Vorovchenko <r.vorovchenko@prequelapp.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

07f1fbb1

Fix bug in ControlNetPipelines with MultiControlNetModel of length 1 (#4032) · 2551b736

Lim Swee Kiat authored Jul 20, 2023

* Fix bug in ControlNetPipelines with MultiControlNetModel of length 1

* Add tests for varying number of ControlNet models

* Fix missing indexing for control_guidance_start and control_guidance_end

* Fix code quality

* Separate test for MultiControlNet with one model

* Revert formatting of earlier test

2551b736