Unverified Commit 8413868d authored by Xin Yang's avatar Xin Yang Committed by GitHub
Browse files

[Bugfix] Fix typo in FusedMoE LoRA reshape comment (#31992)


Signed-off-by: default avatarXin Yang <xyangx@amazon.com>
parent 8ff4a995
......@@ -632,7 +632,7 @@ class LoRAModelManager:
num_experts, -1, down_proj_lora.lora_a.shape[-1]
)
# (output_size,num_experts,rank)
# (output_size,rank,num_experts)
gate_up_proj_lora.lora_b = gate_up_proj_lora.lora_b.reshape(
gate_up_proj_lora.lora_b.shape[0], -1, num_experts
)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment