[`PEFT` / `LoRA` ] Kohya checkpoints support (#5202)

kohya support

[`PEFT` / `LoRA` ] Kohya checkpoints support (#5202)
kohya support
39baf0b4 · Younes Belkada · GitHub · 1c4c4c48 · 39baf0b4
Unverified Commit 39baf0b4 authored Sep 28, 2023 by Younes Belkada Committed by GitHub Sep 28, 2023
Show whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

src/diffusers/utils/state_dict_utils.py src/diffusers/utils/state_dict_utils.py +2 -0

No files found.
--- a/src/diffusers/utils/state_dict_utils.py
+++ b/src/diffusers/utils/state_dict_utils.py
@@ -37,6 +37,8 @@ DIFFUSERS_TO_PEFT = {
    ".v_proj.lora_linear_layer.down": ".v_proj.lora_A",
    ".out_proj.lora_linear_layer.up": ".out_proj.lora_B",
    ".out_proj.lora_linear_layer.down": ".out_proj.lora_A",
+    ".lora_linear_layer.up": ".lora_B",
+    ".lora_linear_layer.down": ".lora_A",
 }

 DIFFUSERS_OLD_TO_PEFT = {