Unverified Commit 5bc1da14 authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

[LoRA][BugFix] Fix skipped LoRA adapters for Mistral3 (#36928)


Signed-off-by: default avatarWoosuk Kwon <woosuk@inferact.ai>
parent 00910171
......@@ -429,6 +429,9 @@ class Mistral3ForConditionalGeneration(
"model.vision_tower.": "vision_tower.",
"model.multi_modal_projector.": "multi_modal_projector.",
"lm_head.": "language_model.lm_head.",
# Some PEFT LoRAs are trained against the text submodule directly
# and produce names like `base_model.model.model.layers.*`.
"model.": "language_model.model.",
}
)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment