Unverified Commit 9279c59a authored by bnellnm's avatar bnellnm Committed by GitHub
Browse files

[MoE Refactor] DefaultMoERunner simplifcation (#33049)


Signed-off-by: default avatarBill Nell <bnell@redhat.com>
parent 74540961
......@@ -504,6 +504,8 @@ class FusedMoE(CustomOp):
self.apply_router_weight_on_input = apply_router_weight_on_input
self.activation = MoEActivation.from_str(activation)
# TODO(bnell): we should not have to create a router if the kernel is
# monolithic.
self.router = create_fused_moe_router(
top_k=top_k,
global_num_experts=self.global_num_experts,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment