Commits · c7250f2b8ae8e4b084dce363da5f9babc733454e · renzhc / diffusers_dcu

"...git@developer.sourcefind.cn:OpenDAS/torchaudio.git" did not exist on "d62875cc67f0ecae75c6edeffa1c74178308e034"

28 Jul, 2023 1 commit

[SDXL Refiner] Fix refiner forward pass for batched input (#4327) · 18b018c8

Patrick von Platen authored Jul 28, 2023

* fix_batch_xl

* Fix other pipelines as well

* up

* up

* Update tests/pipelines/stable_diffusion_xl/test_stable_diffusion_xl_inpaint.py

* sort

* up

* Finish it all up Co-authored-by: Bagheera <bghira@users.github.com>

* Co-authored-by: Bagheera bghira@users.github.com

* Co-authored-by: Bagheera <bghira@users.github.com>

* Finish it all up Co-authored-by: Bagheera <bghira@users.github.com>

18b018c8

27 Jul, 2023 4 commits
- [Local loading] Correct bug with local files only (#4318) · 1926331e
  Patrick von Platen authored Jul 27, 2023
```
* [Local loading] Correct bug with local files only

* file not found error

* fix

* finish
```
  1926331e
- fix a bug in StableDiffusionUpscalePipeline when `prompt` is `None` (#4278) · 5fd3dca5
  YiYi Xu authored Jul 27, 2023
```
* fix batch_size

* add test

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
```
  5fd3dca5
- Fix SDXL conversion from original to diffusers (#4280) · a2091b70
  Duong A. Nguyen authored Jul 27, 2023
```
* fix sdxl conversion

* convention
```
  a2091b70
- [Torch.compile] Fixes torch compile graph break (#4315) · d8bc1a4e
  Patrick von Platen authored Jul 27, 2023
```
* fix torch compile

* Fix all

* make style
```
  d8bc1a4e
26 Jul, 2023 4 commits

0.20.0dev0 (#4299) · 20e92586
Patrick von Platen authored Jul 26, 2023
```
* 0.20.0dev0

* make style
```
20e92586
quick fix · 16049caf
Patrick von Platen authored Jul 26, 2023

16049caf

Rename (#4294) · 6a6dfe1c

Patrick von Platen authored Jul 26, 2023

* up

* Apply suggestions from code review

* Apply suggestions from code review

* up

6a6dfe1c

[Kandinsky] Add combined pipelines / Fix cpu model offload / Fix inpainting (#4207) · b3e5cd6b

Patrick von Platen authored Jul 26, 2023



* Add combined pipeline

* Download readme

* Upload

* up

* up

* fix final

* Add enable model cpu offload kandinsky

* finish

* finish

* Fix

* fix more

* make style

* fix kandinsky mask

* fix inpainting test

* add callbacks

* add tests

* fix tests

* Apply suggestions from code review
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* docs

* docs

* correct docs

* fix tests

* add warning

* correct docs

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

b3e5cd6b

25 Jul, 2023 11 commits

Fix all missing optional import statements from pipeline folders (#4272) · b37dc3b3
Patrick von Platen authored Jul 26, 2023
```
* fix circular import

* fix imports when watermark not specified

* fix all pipelines
```
b37dc3b3

Load Kohya-ss style LoRAs with auxilary states (#4147) · ff8f5808

Batuhan Taskaya authored Jul 26, 2023



* Support to load Kohya-ss style LoRA file format (without restrictions)
Co-Authored-By: Takuma Mori <takuma104@gmail.com>
Co-Authored-By: Sayak Paul <spsayakpaul@gmail.com>

* tmp: add sdxl to mlp_modules

---------
Co-authored-by: Takuma Mori <takuma104@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

ff8f5808

[SDXL DreamBooth LoRA] multiple fixes (#4262) · 161449d5

Sayak Paul authored Jul 26, 2023

* add automatic licensing.

* debugging

* debugging

* more debugging

* more debugging.

* run make fix-copies.

* change to default tracker.

161449d5

[SDXL and IP2P]: instruction pix2pix XL training and pipeline (#4079) · 428dbfec

Harutatsu Akiyama authored Jul 25, 2023



* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* [Community] Implementation of the IADB community pipeline (#3996)

* community pipeline: implementation of iadb

* iadb.py: reformat using black

* iadb.py: linting update

* add kandinsky to readme table (#4081)
Co-authored-by: yiyixuxu <yixu310@gmail,com>

* [From Single File] Force accelerate to be installed (#4078)

force accelerate to be installed

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Support instruction pix2pix sdxl

* Clean up IP2P SDXL code

* Clean up IP2P SDXL code

* [IP2P and SDXL] clean up code

* [IP2P and SDXL] clean up code

* [IP2P and SDXL] clean up code

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews, add docs, tests

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Add README_SDXL

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Address code reviews

* [IP2P SDXL] Fix the copy problems

* [IP2P SDXL] Add license

* [IP2P SDXL] Add license

* [IP2P SDXL] Add license

* [IP2P SDXL] Address code reivew for selecting VAE andd others

* [IP2P SDXL] Update README_sdxl

* [IP2P SDXL] Update __init__

* [IP2P SDXL] Update dummy_torch_and_transformers_and_invisible_watermark_objects

* address patrick's comments and some additions to readmes.

---------
Co-authored-by: Harutatsu Akiyama <kf.zy.qin@gmail.com>
Co-authored-by: Thomas Chambon <36728882+tchambon@users.noreply.github.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

428dbfec

[from_single_file] Fix circular import (#4259) · ebfe3431
Patrick von Platen authored Jul 25, 2023
```
* up

* finish

* fix final
```
ebfe3431

[draft v2] AutoPipeline (#4138) · c11d11d6

YiYi Xu authored Jul 25, 2023



* initial

* style

* from ...pipelines -> from ..pipeline_util

* make style

* fix-copies

* fix value_guided_sampling oops

* style

* add test

* Show failing test

* update from_pipe

* fix

* add controlnet, additional test and register unused original config

* update for controlnet

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* store unused config as private attribute and pass if can

* add doc

* kandinsky inpaint pipeline does not work with decoder checkpoint

* update doc

* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* style

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* fix

* Apply suggestions from code review

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

c11d11d6

[SDXL] Improve docs (#4196) · d74561da

Patrick von Platen authored Jul 25, 2023



* Improve docs

* Correct docs

* Add better example inpaint

* make style

* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* fix

---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

d74561da

[From Single File] Allow vae to be loaded (#4242) · a0422ed0
Patrick von Platen authored Jul 25, 2023
```
* Allow vae to be loaded

* up
```
a0422ed0

Resolve bf16 error as mentioned in this... · 5652c43f

nupurkmr9 authored Jul 24, 2023

Resolve bf16 error as mentioned in this [issue](https://github.com/huggingface/diffusers/issues/4139#issuecomment-1639977304) (#4214)

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

* resolve bf16 error

5652c43f

[SDXL DreamBooth LoRA] add support for text encoder fine-tuning (#4097) · 365e8461

Sayak Paul authored Jul 25, 2023



* Allow low precision sd xl

* finish

* finish

* feat: initial draft for supporting text encoder lora finetuning for SDXL DreamBooth

* fix: variable assignments.

* add: autocast block.

* add debugging

* vae dtype hell

* fix: vae dtype hell.

* fix: vae dtype hell 3.

* clean up

* lora text encoder loader.

* fix: unwrapping models.

* add: tests.

* docs.

* handle unexpected keys.

* fix vae dtype in the final inference.

* fix scope problem.

* fix: save_model_card args.

* initialize: prefix to None.

* fix: dtype issues.

* apply gixes.

* debgging.

* debugging

* debugging

* debugging

* debugging

* debugging

* add: fast tests.

* pre-tokenize.

* address: will's comments.

* fix: loader and tests.

* fix: dataloader.

* simplify dataloader.

* length.

* simplification.

* make style && make quality

* simplify state_dict munging

* fix: tests.

* fix: state_dict packing.

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

365e8461

[ControlNet SDXL training] fixes in the training script (#4223) · fed12376

Sayak Paul authored Jul 25, 2023

* fix: #4206

* add: sdxl controlnet training smoketest.

* remove unnecessary token inits.

* add: licensing to model card.

* include SDXL licensing in the model card and make public visibility default

* debugging

* debugging

* disable local file download.

* fix: training test.

* fix: ckpt prefix.

fed12376

24 Jul, 2023 9 commits

[Docs] Fix from pretrained docs (#4240) · 95b7de88
Patrick von Platen authored Jul 24, 2023
```
* [Docs] Fix from pretrained docs

* [Docs] Fix from pretrained docs
```
95b7de88
[docs] Other modalities (#4205) · 5470a4fc
Steven Liu authored Jul 24, 2023
```
remove coming soon, rl pipeline
```
5470a4fc

Allow specifying denoising_start and denoising_end as integers representing... · e98fabc5

39th president of the United States, probably authored Jul 24, 2023

Allow specifying denoising_start and denoising_end as integers representing the discrete timesteps, fixing the XL ensemble not working for many schedulers (#4115)

* Fix the XL ensemble not working for any kerras scheduler sigmas and having an off by one bug

* Update src/diffusers/pipelines/stable_diffusion_xl/pipeline_stable_diffusion_xl.py

* make sytle

---------

Co-authored-by: Jimmy <39@🇺🇸

.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

e98fabc5

[SD-XL] Fix sdxl controlnet inference (#4238) · 3ba36f97
Patrick von Platen authored Jul 24, 2023
```
* Fix controlnet xl inference

* correct some sd xl control inference
```
3ba36f97
[SDXL] Fix sd xl encode prompt (#4237) · b288684d
Patrick von Platen authored Jul 24, 2023
```
* [SDXL] Fix sd xl encode prompt

* add tests
```
b288684d
Raise initial HTTPError if pipeline is not cached locally (#4230) · 06eda5b2
Lucain authored Jul 24, 2023
```
* Raise initial HTTPError if pipeline is not cached locally

* make style
```
06eda5b2

fix a bug of `prompt embeds` in sdxl (#4099) · 8e5921ca

Hu Ye authored Jul 24, 2023



* fix bug in sdxl

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl_inpaint.py

* Update pipeline_stable_diffusion_xl.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl_inpaint.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_controlnet_sd_xl.py

* Update pipeline_controlnet_sd_xl.py

* Update pipeline_stable_diffusion_xl.py

* Update pipeline_stable_diffusion_xl_img2img.py

* Update pipeline_stable_diffusion_xl_inpaint.py

* Update test_stable_diffusion_xl.py

* Update test_stable_diffusion_xl.py

* Update test_stable_diffusion_xl.py

add test on prompt_embeds

* add test on prompt_embeds

---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

8e5921ca

fix no CFG for kandinsky pipelines (#4193) · 8e8954bd

YiYi Xu authored Jul 23, 2023



* fix bug when no cfg

* style

* fix no cfg for shap-e and cycle

* style

* fix no cfg for sdxl

* fix copies

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>

8e8954bd

[fix] `network_alpha` when loading unet lora from old format (#4221) · 09fab561
Jackmin801 authored Jul 24, 2023
```
fix: missed network_alpha when loading lora from old format
```
09fab561

21 Jul, 2023 6 commits

[docs] Clean up pipeline apis (#3905) · a69754bb

Steven Liu authored Jul 21, 2023

* start with stable diffusion

* fix

* finish stable diffusion pipelines

* fix path to pipeline output

* fix flax paths

* fix copies

* add up to score sde ve

* finish first pass of pipelines

* fix copies

* second review

* align doc titles

* more review fixes

* final review

a69754bb

Allow passing different prompts to each `text_encoder` on `stable_diffusion_xl` pipelines (#4156) · aed30dff

apolinário authored Jul 21, 2023



* sdxl prompt2

* Improve checks

* doc linting

* whoops

* remove cat

* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Add other pipelines and tests

* Add multi-prompting to docs

* doc and copies check

* Fix copied froms

* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Bring back the original code for unrelated files

* Fix tests

* Fix img2img

* Fix all

* fix

---------
Co-authored-by: multimodalart <joaopaulo.passos+multimodal@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

aed30dff

make enable_sequential_cpu_offload more generic for third-party devices (#4191) · e2bbaa4f
statelesshz authored Jul 21, 2023
```
* make enable_sequential_cpu_offload more generic for third-party devices

* make style
```
e2bbaa4f
[Safetensors] make safetensors a required dep (#4177) · 1e853e24
Patrick von Platen authored Jul 21, 2023

1e853e24
Fix unloading of LoRAs when xformers attention procs are in use (#4179) · ad787082
Batuhan Taskaya authored Jul 21, 2023

ad787082
[From single file] Make sure that controlnet stays False for from_single_file (#4181) · b7a6e34c
Patrick von Platen authored Jul 21, 2023
```
* fix from signle file

* Make sure converison always works with safetensors
```
b7a6e34c

20 Jul, 2023 4 commits

Shap-E: add support for mesh output (#4062) · 47b33464

YiYi Xu authored Jul 20, 2023



* add output_type=mesh

* update img2img

* make style

* add doc

* make style

* Apply suggestions from code review
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* add docstring for output_type

* add a section in doc about hub mesh visualization/ rotation

* update conversion script so default background is white

* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update src/diffusers/pipelines/shap_e/pipeline_shap_e_img2img.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* renderer -> shap_e_renderer

* img2img renderer -> shap_e_renderer

* fix tests

---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

47b33464

Asymmetric vqgan (#3956) · 07f1fbb1

Ruslan Vorovchenko authored Jul 20, 2023



* added AsymmetricAutoencoderKL

* fixed copies+dummy

* added script to convert original asymmetric vqgan

* added docs

* updated docs

* fixed style

* fixes, added tests

* update doc

* fixed doc

* fixed tests

* naming
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* naming
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* udpated code example

* updated doc

* comments fixes

* added docstring
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* comments fixes

* added inpaint pipeline tests

* comment suggestion: delete method

* yet another fixes

---------
Co-authored-by: Ruslan Vorovchenko <r.vorovchenko@prequelapp.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

07f1fbb1

Fix bug in ControlNetPipelines with MultiControlNetModel of length 1 (#4032) · 2551b736

Lim Swee Kiat authored Jul 20, 2023

* Fix bug in ControlNetPipelines with MultiControlNetModel of length 1

* Add tests for varying number of ControlNet models

* Fix missing indexing for control_guidance_start and control_guidance_end

* Fix code quality

* Separate test for MultiControlNet with one model

* Revert formatting of earlier test

2551b736

fix incorrect attention head dimension in AttnProcessor2_0 (#4154) · 930c8fdc
Allen Zhang authored Jul 20, 2023
```
fix inner_dim
```
930c8fdc

19 Jul, 2023 1 commit

Add controlnet and vae from single file (#4084) · 6b1abba1

Patrick von Platen authored Jul 19, 2023



* Add controlnet from single file

* Updates

* make style

* finish

* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

6b1abba1