"...git@developer.sourcefind.cn:OpenDAS/torchaudio.git" did not exist on "c977afe0272a03b59239c9e104c875d8c2fda1eb"
Unverified Commit e7696e20 authored by Alex Umnov's avatar Alex Umnov Committed by GitHub
Browse files

Updated lora inference instructions (#6913)



* Updated lora inference instructions

* Update examples/dreambooth/README.md
Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>

* Update README.md

* Update README.md

---------
Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
parent 4b89aeff
......@@ -376,18 +376,14 @@ After training, LoRA weights can be loaded very easily into the original pipelin
load the original pipeline:
```python
from diffusers import DiffusionPipeline, DPMSolverMultistepScheduler
import torch
pipe = DiffusionPipeline.from_pretrained("runwayml/stable-diffusion-v1-5", torch_dtype=torch.float16)
pipe.scheduler = DPMSolverMultistepScheduler.from_config(pipe.scheduler.config)
pipe.to("cuda")
from diffusers import DiffusionPipeline
pipe = DiffusionPipeline.from_pretrained("base-model-name").to("cuda")
```
Next, we can load the adapter layers into the UNet with the [`load_attn_procs` function](https://huggingface.co/docs/diffusers/api/loaders#diffusers.loaders.UNet2DConditionLoadersMixin.load_attn_procs).
Next, we can load the adapter layers into the pipeline with the [`load_lora_weights` function](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters#lora).
```python
pipe.unet.load_attn_procs("patrickvonplaten/lora_dreambooth_dog_example")
pipe.load_lora_weights("path-to-the-lora-checkpoint")
```
Finally, we can run the model in inference.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment