Unverified Commit bed05878 authored by Xiaoyu Zhang's avatar Xiaoyu Zhang Committed by GitHub
Browse files

fix kimi vl running bug after rebase main (#5461)

parent b2a189dd
...@@ -220,6 +220,8 @@ def biased_grouped_topk( ...@@ -220,6 +220,8 @@ def biased_grouped_topk(
# TODO: moe_fused_gate kernel is not supported for n_share_experts_fusion > 0 now. # TODO: moe_fused_gate kernel is not supported for n_share_experts_fusion > 0 now.
if ( if (
_is_cuda _is_cuda
and gating_output.shape[1] // num_expert_group
<= 32 # moe_fused_gate kernel ensure that num_experts/num_expert_group does not exceed MAX_VPT=32 now. And when kernel can handle MAX_VPT > 32, we can remove this assertion.
and n_share_experts_fusion == 0 and n_share_experts_fusion == 0
and is_power_of_two(correction_bias.shape[0]) and is_power_of_two(correction_bias.shape[0])
): ):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment