Unverified Commit ac49dac0 authored by JieXin Liang's avatar JieXin Liang Committed by GitHub
Browse files

[fix] fix dsv3_router_gemm filter (#7750)

parent 1e0e5497
......@@ -233,7 +233,8 @@ class MoEGate(nn.Module):
)
if (
hidden_states.shape[0] < 4
_is_cuda
and hidden_states.shape[0] < 4
and hidden_states.shape[1] == 7168
and self.weight.shape[0] == 256
and _device_sm >= 90
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment