Unverified Commit a9b8b13e authored by bnellnm's avatar bnellnm Committed by GitHub
Browse files

[Bugfix] Fix misnamed parameter in compressed_tensors_moe.py (#35813)


Signed-off-by: default avatarBill Nell <bnell@redhat.com>
Co-authored-by: default avatarRobert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
parent e7213003
...@@ -887,7 +887,7 @@ class CompressedTensorsW8A8Fp8MoEMethod(CompressedTensorsMoEMethod): ...@@ -887,7 +887,7 @@ class CompressedTensorsW8A8Fp8MoEMethod(CompressedTensorsMoEMethod):
w13, w13,
w13_scale, w13_scale,
shard_size=layer.intermediate_size_per_partition, shard_size=layer.intermediate_size_per_partition,
num_experts=layer.num_local_experts, num_experts=layer.local_num_experts,
is_act_and_mul=self.moe.is_act_and_mul, is_act_and_mul=self.moe.is_act_and_mul,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment