Skip to content

GitLab

Unverified Commit 8413868d authored by Xin Yang's avatar Xin Yang Committed by GitHub
Browse files

[Bugfix] Fix typo in FusedMoE LoRA reshape comment (#31992) 


Signed-off-by: default avatarXin Yang <xyangx@amazon.com>
parent 8ff4a995
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/lora/model_manager.py
View file @ 8413868d
...@@ -632,7 +632,7 @@ class LoRAModelManager: ...@@ -632,7 +632,7 @@ class LoRAModelManager:
num_experts, -1, down_proj_lora.lora_a.shape[-1] num_experts, -1, down_proj_lora.lora_a.shape[-1]
) )
# (output_size,num_experts,rank) # (output_size,rank,num_experts)
gate_up_proj_lora.lora_b = gate_up_proj_lora.lora_b.reshape( gate_up_proj_lora.lora_b = gate_up_proj_lora.lora_b.reshape(
gate_up_proj_lora.lora_b.shape[0], -1, num_experts gate_up_proj_lora.lora_b.shape[0], -1, num_experts
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment