Skip to content

GitLab

Unverified Commit f1a6e6fd authored by Rick Ho's avatar Rick Ho Committed by GitHub
Browse files

Revert "convert input to same type as weight for mixed precision training"

parent 3a0eb3e6
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
fmoe/linear.py
View file @ f1a6e6fd
...@@ -70,7 +70,7 @@ class FMoELinear(nn.Module): ...@@ -70,7 +70,7 @@ class FMoELinear(nn.Module):
r""" r"""
Call MOE function Call MOE function
""" """
x = MOELinear.apply(inp.type_as(self.weight), fwd_expert_count, self.weight, self.bias) x = MOELinear.apply(inp, fwd_expert_count, self.weight, self.bias)
return x return x
def extra_repr(self) -> str: def extra_repr(self) -> str:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment