Commits · 6b288ec44d80cf1fde57fac8e0e625f7fc0d720f · renzhc / diffusers_dcu

29 Nov, 2024 1 commit

make `pipelines` tests device-agnostic (part2) (#9400) · 6b288ec4

Fanli Lin authored Nov 29, 2024



* enable on xpu

* add 1 more

* add one more

* enable more

* add 1 more

* add more

* enable 1

* enable more cases

* enable

* enable

* update comment

* one more

* enable 1

* add more cases

* enable xpu

* add one more caswe

* add more cases

* add 1

* add more

* add more cases

* add case

* enable

* add more

* add more

* add more

* enbale more

* add more

* update code

* update test marker

* add skip back

* update comment

* remove single files

* remove

* style

* add

* revert

* reformat

* enable

* enable esingle g

* add 2 more

* update decorator

* update

* update

* update

* Update tests/pipelines/deepfloyd_if/test_if.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update src/diffusers/utils/testing_utils.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* update float16

* no unitest.skipt

* update

* apply style check

* adapt style

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

6b288ec4

28 Nov, 2024 5 commits

Change image_gen_aux repository URL (#10048) · fdec8bd6
Álvaro Somoza authored Nov 28, 2024
```
change image_gen_aux repo url
```
fdec8bd6

Add sdxl controlnet reference community pipeline (#9893) · 069186fa

Dimitri Barbot authored Nov 28, 2024



* Add reference_attn & reference_adain support for sdxl with other controlnet

* Update README.md

* Update README.md by replacing human example with a cat one

Replace human example with a cat one

* Replace default human example with a cat one

* Use example images from huggingface documentation-images repository

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

069186fa

[Community Pipeline] Add some feature for regional prompting pipeline (#9874) · 69c83d6e

cjkangme authored Nov 28, 2024



* [Fix] fix bugs of  regional_prompting pipeline

* [Feat] add base prompt feature

* [Fix] fix __init__ pipeline error

* [Fix] delete unused args

* [Fix] improve string handling

* [Docs] docs to use_base in regional_prompting

* make style

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

69c83d6e

Update sdxl reference pipeline to latest sdxl pipeline (#9938) · e44fc75a

Dimitri Barbot authored Nov 28, 2024



* Update sdxl reference community pipeline

* Update README.md

Add example images.

* Style & quality

* Use example images from huggingface documentation-images repository

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

e44fc75a

Add `beta`, `exponential` and `karras` sigmas to `FlowMatchEulerDiscreteScheduler` (#10001) · e47cc1fc
hlky authored Nov 28, 2024
```
Add beta, exponential and karras sigmas to FlowMatchEuler
```
e47cc1fc

27 Nov, 2024 2 commits
- Sd35 controlnet (#10020) · 75bd1e83
  YiYi Xu authored Nov 27, 2024
```
* add model/pipeline
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
```
  75bd1e83
- Notebooks for Community Scripts-3 (#10032) · 8d477dae
  Parag Ekbote authored Nov 27, 2024
```
* Add Notebooks for Community Scripts
in  ReadME.

* Minor Script Improvement.
```
  8d477dae
26 Nov, 2024 1 commit
- [docs] Fix CogVideoX table (#10008) · ad5ecd12
  Aryan authored Nov 26, 2024
```
* fix

* fix
```
  ad5ecd12
25 Nov, 2024 2 commits
- Add prompt about wandb in examples/dreambooth/readme. (#10014) · 074e1235
  SkyCol authored Nov 25, 2024
```
Add files via upload
```
  074e1235
- [Docs] add: missing pipelines from the spec. (#10005) · 047bf492
  Sayak Paul authored Nov 25, 2024
```
add: missing pipelines from the spec.
```
  047bf492
24 Nov, 2024 1 commit

[SD3 dreambooth lora] smol fix to checkpoint saving (#9993) · c4b5d2ff

Linoy Tsaban authored Nov 24, 2024

* smol change to fix checkpoint saving & resuming (as done in train_dreambooth_sd3.py)

* style

* modify comment to explain reasoning behind hidden size check

c4b5d2ff

23 Nov, 2024 1 commit

Flux Fill, Canny, Depth, Redux (#9985) · 7ac6e286

Aryan authored Nov 23, 2024



* update

---------
Co-authored-by: yiyixuxu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

7ac6e286

22 Nov, 2024 3 commits

ControlNet from_single_file when already converted (#9978) · b5fd6f13
hlky authored Nov 22, 2024
```
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
```
b5fd6f13

make `pipelines` tests device-agnostic (part1) (#9399) · 64b3e0f5

Fanli Lin authored Nov 22, 2024



* enable on xpu

* add 1 more

* add one more

* enable more

* add 1 more

* add more

* enable 1

* enable more cases

* enable

* enable

* update comment

* one more

* enable 1

* add more cases

* enable xpu

* add one more caswe

* add more cases

* add 1

* add more

* add more cases

* add case

* enable

* add more

* add more

* add more

* enbale more

* add more

* update code

* update test marker

* add skip back

* update comment

* remove single files

* remove

* style

* add

* revert

* reformat

* update decorator

* update

* update

* update

* Update tests/pipelines/deepfloyd_if/test_if.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update src/diffusers/utils/testing_utils.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* update float16

* no unitest.skipt

* update

* apply style check

* reapply format

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

64b3e0f5

[Tests] skip nan lora tests on PyTorch 2.5.1 CPU. (#9975) · 2e86a3f0

Sayak Paul authored Nov 22, 2024

* skip nan lora tests on PyTorch 2.5.1 CPU.

* cog

* use xfail

* correct xfail

* add condition

* tests

2e86a3f0

21 Nov, 2024 1 commit
- Fix prepare latent image ids and vae sample generators for flux (#9981) · cd6ca9df
  Aryan authored Nov 21, 2024
```
* fix

* update expected slice
```
  cd6ca9df
20 Nov, 2024 6 commits

fix controlnet module refactor (#9968) · e564abe2
YiYi Xu authored Nov 20, 2024
```
* fix
```
e564abe2

Update handle single blocks on _convert_xlabs_flux_lora_to_diffusers (#9915) · 3139d39f

raulmosa authored Nov 20, 2024



* Update handle single blocks on _convert_xlabs_flux_lora_to_diffusers to fix bug on updating keys and old_state_dict


---------
Co-authored-by: raul_ar <raul.moreno.salinas@autoretouch.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

3139d39f

Improve control net block index for sd3 (#9758) · 12358622
linjiapro authored Nov 20, 2024
```
* improve control net index

---------
Co-authored-by: YiYi Xu <yixu310@gmail.com>
```
12358622
[LoRA] enable LoRA for Mochi-1 (#9943) · 805aa937
Sayak Paul authored Nov 21, 2024
```
* feat: add lora support to Mochi-1.
```
805aa937

Flux latents fix (#9929) · f6f7afa1

Dhruv Nair authored Nov 20, 2024



* update

* update

* update

* update

* update

* update

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

f6f7afa1

Fix beta and exponential sigmas + add tests (#9954) · 637e2302

hlky authored Nov 20, 2024



* Fix beta and exponential sigmas + add tests

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

637e2302

19 Nov, 2024 6 commits

add skip_layers argument to SD3 transformer model class (#9880) · 99c0483b

Bagheera authored Nov 19, 2024



* add skip_layers argument to SD3 transformer model class

* add unit test for skip_layers in stable diffusion 3

* sd3: pipeline should support skip layer guidance

* up

---------
Co-authored-by: bghira <bghira@users.github.com>
Co-authored-by: yiyixuxu <yixu310@gmail.com>

99c0483b

Move IP Adapter Scripts to research project (#9960) · cc7d88f2

Parag Ekbote authored Nov 20, 2024



* Move files to research-projects.

* docs: add IP Adapter training instructions

* Delete venv

* Update examples/ip_adapter/tutorial_train_sdxl.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Cherry-picked commits and re-moved files
to research_projects.

* make style.

* Update toctree and delete ip_adapter.

* Nit Fix

* Fix nit.

* Fix nit.

* Create training script for single GPU and set
model format to .safetensors

* Add sample inference script and restore _toctree

* Restore toctree.yaml

* fix spacing.

* Update toctree.yaml

---------
Co-authored-by: AMohamedAakhil <a.aakhilmohamed@gmail.com>
Co-authored-by: BootesVoid <78485654+AMohamedAakhil@users.noreply.github.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

cc7d88f2

[CI] Unpin torch<2.5 in CI (#9961) · ea40933f
Dhruv Nair authored Nov 19, 2024
```
* update

* update
```
ea40933f
Make CogVideoX RoPE implementation consistent (#9963) · 0583a8d1
Aryan authored Nov 19, 2024
```
* update cogvideox rope implementation

* apply suggestions from review
```
0583a8d1
[LoRA] feat: `save_lora_adapter()` (#9862) · 7d0b9c4d
Sayak Paul authored Nov 19, 2024
```
* feat: save_lora_adapter.
```
7d0b9c4d

[advanced flux training] bug fix + reduce memory cost as in #9829 (#9838) · acf479bd

Linoy Tsaban authored Nov 18, 2024

* memory improvement as done here: https://github.com/huggingface/diffusers/pull/9829



* fix bug

* fix bug

* style

---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

acf479bd

18 Nov, 2024 5 commits

Notebooks for Community Scripts-2 (#9952) · 03bf77c4
Parag Ekbote authored Nov 19, 2024
```
4 Notebooks for Community Scripts and minor
script improvements.
```
03bf77c4

CogVideoX 1.5 (#9877) · 3b283061

Yuxuan.Zhang authored Nov 19, 2024



* CogVideoX1_1PatchEmbed test

* 1360 * 768

* refactor

* make style

* update docs

* add modeling tests for cogvideox 1.5

* update

* make fix-copies

* add ofs embed(for convert)

* add ofs embed(for convert)

* more resolution for cogvideox1.5-5b-i2v

* use even number of latent frames only

* update pipeline implementations

* make style

* set patch_size_t as None by default

* #skip frames 0

* refactor

* make style

* update docs

* fix ofs_embed

* update docs

* invert_scale_latents

* update

* fix

* Update docs/source/en/api/pipelines/cogvideox.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/api/pipelines/cogvideox.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/api/pipelines/cogvideox.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/api/pipelines/cogvideox.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update src/diffusers/models/transformers/cogvideox_transformer_3d.py

* update conversion script

* remove copied from

* fix test

* Update docs/source/en/api/pipelines/cogvideox.md

* Update docs/source/en/api/pipelines/cogvideox.md

* Update docs/source/en/api/pipelines/cogvideox.md

* Update docs/source/en/api/pipelines/cogvideox.md

---------
Co-authored-by: Aryan <aryan@huggingface.co>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

3b283061

Add server example (#9918) · c3c94fe7

Grant Sherrick authored Nov 18, 2024



* Add server example.

* Minor updates to README.

* Add fixes after local testing.

* Apply suggestions from code review

Updates to README from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* More doc updates.

* Maybe this will work to build the docs correctly?

* Fix style issues.

* Fix toc.

* Minor reformatting.

* Move docs to proper loc.

* Fix missing tick.

* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Sync docs changes back to README.

* Very minor update to docs to add space.

---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

c3c94fe7

Fixed Nits in Docs and Example Script (#9940) · 365a9388
Parag Ekbote authored Nov 18, 2024
```
Fixed nits in docs and example script.
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
```
365a9388
Add all AttnProcessor classes in `AttentionProcessor` type (#9909) · 345907f3
ちくわぶ authored Nov 18, 2024
```
Add all AttnProcessor in `AttentionProcessor` type
```
345907f3

17 Nov, 2024 2 commits

Correct pipeline_output.py to the type Mochi (#9945) · 07d0fbf3
_ authored Nov 17, 2024
```
Correct pipeline_output.py
```
07d0fbf3

Modify apply_overlay for inpainting with padding_mask_crop (Inpainting area: "Only Masked") (#8793) · 1d2204d3

Heavenn authored Nov 17, 2024



* Modify apply_overlay for inpainting

* style

---------
Co-authored-by: root <root@debian>
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com>
Co-authored-by: yiyixuxu <yixu310@gmail.com>

1d2204d3

16 Nov, 2024 3 commits
- Update ip_adapter.py (#8882) · d38c50c8
  高佳宝 authored Nov 17, 2024
```
update comments of load_ip_adapter function
```
  d38c50c8
- Move Wuerstchen Dreambooth to research_projects (#9935) · e2559207
  Parag Ekbote authored Nov 16, 2024
```
update file paths to research_projects folder.
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
```
  e2559207
- add depth controlnet sd3 pre-trained checkpoints to docs (#9937) · 40ab1c03
  Pakkapon Phongthawee authored Nov 16, 2024
  
  40ab1c03
14 Nov, 2024 1 commit

Update pipeline_flux_img2img.py (#9928) · 5c94937d

Sam authored Nov 14, 2024

* Update pipeline_flux_img2img.py

Added FromSingleFileMixin to this pipeline loader like the other FLUX pipelines.

* Update pipeline_flux_img2img.py

typo

* modified:   src/diffusers/pipelines/flux/pipeline_flux_img2img.py

5c94937d