Unverified Commit e44fc75a authored by Dimitri Barbot's avatar Dimitri Barbot Committed by GitHub
Browse files

Update sdxl reference pipeline to latest sdxl pipeline (#9938)



* Update sdxl reference community pipeline

* Update README.md

Add example images.

* Style & quality

* Use example images from huggingface documentation-images repository

---------
Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
parent e47cc1fc
...@@ -2619,16 +2619,17 @@ for obj in range(bs): ...@@ -2619,16 +2619,17 @@ for obj in range(bs):
### Stable Diffusion XL Reference ### Stable Diffusion XL Reference
This pipeline uses the Reference. Refer to the [stable_diffusion_reference](https://github.com/huggingface/diffusers/blob/main/examples/community/README.md#stable-diffusion-reference). This pipeline uses the Reference. Refer to the [Stable Diffusion Reference](https://github.com/huggingface/diffusers/blob/main/examples/community/README.md#stable-diffusion-reference) section for more information.
```py ```py
import torch import torch
from PIL import Image # from diffusers import DiffusionPipeline
from diffusers.utils import load_image from diffusers.utils import load_image
from diffusers import DiffusionPipeline
from diffusers.schedulers import UniPCMultistepScheduler from diffusers.schedulers import UniPCMultistepScheduler
input_image = load_image("https://hf.co/datasets/huggingface/documentation-images/resolve/main/diffusers/input_image_vermeer.png") from .stable_diffusion_xl_reference import StableDiffusionXLReferencePipeline
input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/sdxl_reference_input_cat.jpg")
# pipe = DiffusionPipeline.from_pretrained( # pipe = DiffusionPipeline.from_pretrained(
# "stabilityai/stable-diffusion-xl-base-1.0", # "stabilityai/stable-diffusion-xl-base-1.0",
...@@ -2646,7 +2647,7 @@ pipe = StableDiffusionXLReferencePipeline.from_pretrained( ...@@ -2646,7 +2647,7 @@ pipe = StableDiffusionXLReferencePipeline.from_pretrained(
pipe.scheduler = UniPCMultistepScheduler.from_config(pipe.scheduler.config) pipe.scheduler = UniPCMultistepScheduler.from_config(pipe.scheduler.config)
result_img = pipe(ref_image=input_image, result_img = pipe(ref_image=input_image,
prompt="1girl", prompt="a dog",
num_inference_steps=20, num_inference_steps=20,
reference_attn=True, reference_attn=True,
reference_adain=True).images[0] reference_adain=True).images[0]
...@@ -2654,14 +2655,14 @@ result_img = pipe(ref_image=input_image, ...@@ -2654,14 +2655,14 @@ result_img = pipe(ref_image=input_image,
Reference Image Reference Image
![reference_image](https://hf.co/datasets/huggingface/documentation-images/resolve/main/diffusers/input_image_vermeer.png) ![reference_image](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/sdxl_reference_input_cat.jpg)
Output Image Output Image
`prompt: 1 girl` `prompt: a dog`
`reference_attn=True, reference_adain=True, num_inference_steps=20` `reference_attn=False, reference_adain=True, num_inference_steps=20`
![Output_image](https://github.com/zideliu/diffusers/assets/34944964/743848da-a215-48f9-ae39-b5e2ae49fb13) ![Output_image](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/sdxl_reference_adain_dog.png)
Reference Image Reference Image
![reference_image](https://github.com/huggingface/diffusers/assets/34944964/449bdab6-e744-4fb2-9620-d4068d9a741b) ![reference_image](https://github.com/huggingface/diffusers/assets/34944964/449bdab6-e744-4fb2-9620-d4068d9a741b)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment