Commits · e02ec27e51751a28a4fa1e0d95537f824d523bbe · renzhc / diffusers_dcu

18 Jul, 2024 1 commit
- [Core] remove `resume_download` from Hub related stuff (#8648) · e02ec27e
  Sayak Paul authored Jul 18, 2024
```
* remove resume_download

* fix: _fetch_index_file call.

* remove resume_download from docs.
```
  e02ec27e
12 Jul, 2024 1 commit
- Add single file loading support for AnimateDiff (#8819) · 11d18f32
  Dhruv Nair authored Jul 12, 2024
```
* update

* update

* update

* update
```
  11d18f32
05 Jul, 2024 1 commit
- [Single File] Allow loading T5 encoder in mixed precision (#8778) · 0bab9d6b
  Dhruv Nair authored Jul 05, 2024
```
* update

* update

* update

* update
```
  0bab9d6b
03 Jul, 2024 2 commits

Revert "[LoRA] introduce `LoraBaseMixin` to promote reusability." (#8773) · 984d3405
Sayak Paul authored Jul 03, 2024
```
Revert "[LoRA] introduce `LoraBaseMixin` to promote reusability. (#8670)"

This reverts commit a2071a18.
```
984d3405

[LoRA] introduce `LoraBaseMixin` to promote reusability. (#8670) · a2071a18

Sayak Paul authored Jul 03, 2024

* introduce  to promote reusability.

* up

* add more tests

* up

* remove comments.

* fix fuse_nan test

* clarify the scope of fuse_lora and unfuse_lora

* remove space

a2071a18

01 Jul, 2024 1 commit
- Remove legacy single file model loading mixins (#8754) · 0368483b
  Dhruv Nair authored Jul 01, 2024
```
update
```
  0368483b
28 Jun, 2024 1 commit

fix: ValueError when using FromOriginalModelMixin in subclasses #8440 (#8454) · a216b0bb

Luo Chaofan authored Jun 28, 2024



* fix: ValueError when using FromOriginalModelMixin in subclasses #8440

(cherry picked from commit 92859978436acf844760fc0e992165b489d0180a)

* Update src/diffusers/loaders/single_file_model.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update single_file_model.py

* Update single_file_model.py

---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

a216b0bb

27 Jun, 2024 1 commit
- [LoRA] fix conversion utility so that lora dora loads correctly (#8688) · adbb0486
  Sayak Paul authored Jun 27, 2024
```
fix conversion utility so that lora dora loads correctly
```
  adbb0486
26 Jun, 2024 2 commits

[LoRA] fix vanilla fine-tuned lora loading. (#8691) · 5b51ad00
Sayak Paul authored Jun 26, 2024
```
fix vanilla fine-tuned lora loading.
```
5b51ad00

Fix: unet save_attn_procs at UNet2DconditionLoadersMixin (#8699) · ea6938ae

Donald.Lee authored Jun 27, 2024



* fix: unet save_attn_procs at custom diffusion

* style: recover unchanaged parts(max line length 119) / mod: add condition

* style: recover unchanaged parts(max line length 119)

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

ea6938ae

25 Jun, 2024 2 commits

add PAG support (#7944) · 540399f5

YiYi Xu authored Jun 25, 2024



* first draft


---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Co-authored-by: Ahn Donghoon (안동훈 / suno) <suno.vivid@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

540399f5

[Sd3 Dreambooth LoRA] Add text encoder training for the clip encoders (#8630) · c6e08ecd

Linoy Tsaban authored Jun 25, 2024



* add clip text-encoder training

* no dora

* text encoder traing fixes

* text encoder traing fixes

* text encoder training fixes

* text encoder training fixes

* text encoder training fixes

* text encoder training fixes

* add text_encoder layers to save_lora

* style

* fix imports

* style

* fix text encoder

* review changes

* review changes

* review changes

* minor change

* add lora tag

* style

* add readme notes

* add tests for clip encoders

* style

* typo

* fixes

* style

* Update tests/lora/test_lora_layers_sd3.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update examples/dreambooth/README_sd3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* minor readme change

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

c6e08ecd

22 Jun, 2024 1 commit
- [LoRA] refactor lora conversion utility. (#8295) · a9c403c0
  Sayak Paul authored Jun 22, 2024
```
* refactor lora conversion utility.

* remove error raises.

* add onetrainer support too.
```
  a9c403c0
21 Jun, 2024 1 commit

[SD3 LoRA] Fix list index out of range (#8584) · e7b9a076

Álvaro Somoza authored Jun 21, 2024



* fix

* add check

* key present is checked before

* test case draft

* aply suggestions

* changed testing repo, back to old class

* forgot docstring

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

e7b9a076

20 Jun, 2024 1 commit

[LoRA SD3] add support for lora fusion in sd3 (#8616) · 668e34c6

Sayak Paul authored Jun 20, 2024

* add support for lora fusion in sd3

* add test to ensure fused lora and effective lora produce same outpouts

668e34c6

19 Jun, 2024 1 commit
- fix from_single_file for checkpoints with t5 (#8631) · 394b8fb9
  YiYi Xu authored Jun 19, 2024
```
fix single file
```
  394b8fb9
18 Jun, 2024 2 commits

[LoRA] text encoder: read the ranks for all the attn modules (#8324) · 298ce679

Gæros authored Jun 18, 2024



* [LoRA] text encoder: read the ranks for all the attn modules

 * In addition to out_proj, read the ranks of adapters for q_proj, k_proj, and  v_proj

 * Allow missing adapters (UNet already supports this)

* ruff format loaders.lora

* [LoRA] add tests for partial text encoders LoRAs

* [LoRA] update test_simple_inference_with_partial_text_lora to be deterministic

* [LoRA] comment justifying test_simple_inference_with_partial_text_lora

* style

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

298ce679

[Single File Loading] Handle unexpected keys in CLIP models when `accelerate`... · f69511ec

Dhruv Nair authored Jun 18, 2024


[Single File Loading] Handle unexpected keys in CLIP models when `accelerate` isn't installed.  (#8462)

* update

* update

* update

* update

* update

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

f69511ec

13 Jun, 2024 1 commit
- Expand Single File support in SD3 Pipeline (#8517) · b1a2c0d5
  Dhruv Nair authored Jun 13, 2024
```
* update

* update
```
  b1a2c0d5
12 Jun, 2024 1 commit

Add Stable Diffusion 3 (#8483) · 04717fd8

Dhruv Nair authored Jun 13, 2024



* up

* add sd3

* update

* update

* add tests

* fix copies

* fix docs

* update

* add dreambooth lora

* add LoRA

* update

* update

* update

* update

* import fix

* update

* Update src/diffusers/pipelines/stable_diffusion_3/pipeline_stable_diffusion_3.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* import fix 2

* update

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* update

* update

* update

* fix ckpt id

* fix more ids

* update

* missing doc

* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update'

* fix

* update

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

* note on gated access.

* requirements

* licensing

---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

04717fd8

05 Jun, 2024 1 commit

[LoRA] Remove legacy LoRA code and related adjustments (#8316) · a0542c19

Sayak Paul authored Jun 05, 2024

* remove legacy code from load_attn_procs.

* finish first draft

* fix more.

* fix more

* add test

* add serialization support.

* fix-copies

* require peft backend for lora tests

* style

* fix test

* fix loading.

* empty

* address benjamin's feedback.

a0542c19

31 May, 2024 1 commit
- Change checkpoint key used to identify CLIP models in single file checkpoints (#8319) · f9fa8a86
  Dhruv Nair authored May 31, 2024
```
update
```
  f9fa8a86
29 May, 2024 1 commit

[Core] Refactor `IPAdapterPlusImageProjection` a bit (#7994) · ba1bfac2

Sayak Paul authored May 29, 2024

* use IPAdapterPlusImageProjectionBlock in IPAdapterPlusImageProjection

* reposition IPAdapterPlusImageProjection

* refactor complete?

* fix heads param retrieval.

* update test dict creation method.

ba1bfac2

28 May, 2024 1 commit
- [LoRA] attempt at fixing onetrainer lora. (#8242) · e6df8eda
  Sayak Paul authored May 28, 2024
```
* attempt at fixing onetrainer lora.

* fix
```
  e6df8eda
24 May, 2024 1 commit
- Respect `resume_download` deprecation V2 (#8267) · edf5ba6a
  Lucain authored May 24, 2024
```
* Fix resume_downoad FutureWarning

* only resume download
```
  edf5ba6a
22 May, 2024 1 commit
- fix: Attribute error in Logger object (logger.warning) (#8183) · 509741ae
  BootesVoid authored May 21, 2024
  
  509741ae
12 May, 2024 1 commit
- [Core] fix offload behaviour when device_map is enabled. (#7919) · 5bb38586
  Sayak Paul authored May 12, 2024
```
fix offload behaviour when device_map is enabled.
```
  5bb38586
09 May, 2024 2 commits

[Tests] fix things after #7013 (#7899) · 305f2b44

Sayak Paul authored May 09, 2024

* debugging

* save the resulting image

* check if order reversing works.

* checking values.

* up

* okay

* checking

* fix

* remove print

305f2b44

[Refactor] Better align `from_single_file` logic with `from_pretrained` (#7496) · cb0f3b49

Dhruv Nair authored May 09, 2024



* refactor unet single file loading a bit.

* retrieve the unet from create_diffusers_unet_model_from_ldm

* update

* update

* updae

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* tests

* update

* update

* update

* Update docs/source/en/api/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/loaders/single_file.py
Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

cb0f3b49

08 May, 2024 1 commit

Allow users to save SDXL LoRA weights for only one text encoder (#7607) · 75aab346

Pierre Dulac authored May 08, 2024



SDXL LoRA weights for text encoders should be decoupled on save

The method checks if at least one of unet, text_encoder and
text_encoder_2 lora weights are passed, which was not reflected in the
implentation.
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

75aab346

03 May, 2024 1 commit

Respect `resume_download` deprecation (#7843) · 6a479588

Lucain authored May 03, 2024



* Deprecate resume_download

* align docstring with transformers

* style

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

6a479588

01 May, 2024 1 commit

update the logic of `is_sequential_cpu_offload` (#7788) · 21a7ff12

YiYi Xu authored May 01, 2024



* up

* add comment to the tests + fix dit

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

21a7ff12

25 Apr, 2024 1 commit

Fix lora device test (#7738) · 142f353e

Sayak Paul authored Apr 25, 2024



* fix lora device test

* fix more.

* fix more/

* quality

* empty

---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

142f353e

22 Apr, 2024 2 commits

Restore AttnProcessor2_0 in unload_ip_adapter (#7727) · 065f2517

Fabio Rigano authored Apr 23, 2024



* Restore AttnProcessor2_0 in unload_ip_adapter

* Fix style

* Update test

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>

065f2517

Support InstantStyle (#7668) · 21c747fa

Jenyuan-Huang authored Apr 23, 2024



* enable control ip-adapter per-transformer block on-the-fly

---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com>
Co-authored-by: ResearcherXman <xhs.research@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>

21c747fa

19 Apr, 2024 1 commit

Move IP Adapter Face ID to core (#7186) · b5c8b555

Fabio Rigano authored Apr 19, 2024



* Switch to peft and multi proj layers

* Move Face ID loading and inference to core

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

b5c8b555

12 Apr, 2024 1 commit
- FIX Setting device for DoRA parameters (#7655) · 2523390c
  Benjamin Bossan authored Apr 12, 2024
```
Fix a bug that causes the the call to set_lora_device to ignore the DoRA
parameters.
```
  2523390c
11 Apr, 2024 1 commit
- fix: Replaced deprecated `logger.warn` with `logger.warning` (#7643) · 279de3c3
  Sai-Suraj-27 authored Apr 12, 2024
```
Fixed deprecated logger.warn with logger.warning.
```
  279de3c3
02 Apr, 2024 1 commit

add: utility to format our docs too

📜

(#7314) · 4a343077

Sayak Paul authored Apr 02, 2024

* add: utility to format our docs too 📜

* debugging saga

* fix: message

* checking

* should be fixed.

* revert pipeline_fixture

* remove empty line

* make style

* fix: setup.py

* style.

4a343077

30 Mar, 2024 1 commit
- Quick-Fix for #7352 block-lora (#7523) · 77103d71
  UmerHA authored Mar 30, 2024
```
Fixed important typo
```
  77103d71