Unverified Commit 7f58a76f authored by xhedit's avatar xhedit Committed by GitHub
Browse files

Update lora.md with a more accurate description of rank (#6724)



* Update lora.md with a more accurate description of rank

* Update docs/source/en/training/lora.md
Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>

---------
Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
parent 09b7bfce
...@@ -104,7 +104,7 @@ accelerate launch train_text_to_image_lora.py \ ...@@ -104,7 +104,7 @@ accelerate launch train_text_to_image_lora.py \
Many of the basic and important parameters are described in the [Text-to-image](text2image#script-parameters) training guide, so this guide just focuses on the LoRA relevant parameters: Many of the basic and important parameters are described in the [Text-to-image](text2image#script-parameters) training guide, so this guide just focuses on the LoRA relevant parameters:
- `--rank`: the number of low-rank matrices to train - `--rank`: the inner dimension of the low-rank matrices to train; a higher rank means more trainable parameters
- `--learning_rate`: the default learning rate is 1e-4, but with LoRA, you can use a higher learning rate - `--learning_rate`: the default learning rate is 1e-4, but with LoRA, you can use a higher learning rate
## Training script ## Training script
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment