Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "8e849eae063fc148bd92e3cc8a7942070be8b702"
Unverified Commit a31fcc55 authored by Rick Ho's avatar Rick Ho Committed by GitHub
Browse files

Merge pull request #151 from laekov/revert-150-patch-1 

Revert "convert input to same type as weight for mixed precision training"
parents 3a0eb3e6 f1a6e6fd
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
fmoe/linear.py
View file @ a31fcc55
...@@ -70,7 +70,7 @@ class FMoELinear(nn.Module): ...@@ -70,7 +70,7 @@ class FMoELinear(nn.Module):
r""" r"""
Call MOE function Call MOE function
""" """
x = MOELinear.apply(inp.type_as(self.weight), fwd_expert_count, self.weight, self.bias) x = MOELinear.apply(inp, fwd_expert_count, self.weight, self.bias)
return x return x
def extra_repr(self) -> str: def extra_repr(self) -> str:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment