"git@developer.sourcefind.cn:OpenDAS/TransformerEngine.git" did not exist on "aecd5a8fae4cbb73c5fa53dc607c9c83ac3626d3"
Unverified Commit 67114f9e authored by Kirthi Shankar Sivamani's avatar Kirthi Shankar Sivamani Committed by GitHub
Browse files

fix bug in non-FP8 nvfuser path (#81)


Signed-off-by: default avatarKirthi Shankar Sivamani <ksivamani@nvidia.com>
parent a3ec6a54
......@@ -2177,7 +2177,7 @@ class _LayerNormMLP(torch.autograd.Function):
gelu=not bias_gelu_nvfusion,
)
if bias_gelu_nvfusion and is_grad_enabled:
if bias_gelu_nvfusion:
fc1_out, _, _ = fc1_outputs
gelu_out = bias_gelu_fused(fc1_out, fc1_bias)
else:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment