Skip to content

GitLab

Unverified Commit ddd0cfb4 authored by Abdellah Oumida's avatar Abdellah Oumida Committed by GitHub
Browse files

Fix typo in train_diffusion_orpo_sdxl_lora_wds.py (#11541)

parent 4f438de3
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/research_projects/diffusion_orpo/train_diffusion_orpo_sdxl_lora_wds.py
View file @ ddd0cfb4
...@@ -812,7 +812,7 @@ def main(args): ...@@ -812,7 +812,7 @@ def main(args):
if args.scale_lr: if args.scale_lr:
args.learning_rate = ( args.learning_rate = (
args.learning_rat * args.gradient_accumulation_steps * args.per_gpu_batch_size * accelerator.num_processes args.learning_rate * args.gradient_accumulation_steps * args.per_gpu_batch_size * accelerator.num_processes
) )
# Use 8-bit Adam for lower memory usage or to fine-tune the model in 16GB GPUs # Use 8-bit Adam for lower memory usage or to fine-tune the model in 16GB GPUs
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment