Unverified Commit 0484b642 authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[Bug] Fix shape issue for eplb expert weights (#27589)


Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
Co-authored-by: default avatarCyrus Leung <tlleungac@connect.ust.hk>
parent f58d9b64
......@@ -1959,6 +1959,8 @@ class FusedMoE(CustomOp):
if name not in NON_EXPERT_WEIGHTS
and weight.shape != torch.Size([])
and not name.startswith("_shared_experts.")
# exclude parameters from non-expert submodules (e.g. gate/shared)
and not name.startswith("_gate.")
]
def set_eplb_state(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment