Skip to content

GitLab

Unverified Commit 15ed53d2 authored by Younes Belkada's avatar Younes Belkada Committed by GitHub
Browse files

Fixes LoRA SDXL training script with DDP + PEFT (#6816) 

Update train_dreambooth_lora_sdxl.py
parent 9cc59ba0
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
examples/dreambooth/train_dreambooth_lora_sdxl.py
View file @ 15ed53d2
...@@ -1399,8 +1399,8 @@ def main(args): ...@@ -1399,8 +1399,8 @@ def main(args):
text_encoder_two.train() text_encoder_two.train()
# set top parameter requires_grad = True for gradient checkpointing works # set top parameter requires_grad = True for gradient checkpointing works
text_encoder_one.text_model.embeddings.requires_grad_(True) accelerator.unwrap_model(text_encoder_one).text_model.embeddings.requires_grad_(True)
text_encoder_two.text_model.embeddings.requires_grad_(True) accelerator.unwrap_model(text_encoder_two).text_model.embeddings.requires_grad_(True)
for step, batch in enumerate(train_dataloader): for step, batch in enumerate(train_dataloader):
with accelerator.accumulate(unet): with accelerator.accumulate(unet):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment