Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "335d372237389a85f4426cf1a05ccedca6923518"
Commit b04eb0a2 authored by Boris Fomitchev's avatar Boris Fomitchev
Browse files

Warning added

parent 9026b86d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
megatron/model/transformer.py
View file @ b04eb0a2
......@@ -24,6 +24,7 @@ try:
_ = FusedLayerNorm(8, eps=1e-5)
except Exception as e:
print('WARNING: APEX is not available, using torch.nn.LayerNorm instead of apex.normalization.FusedLayerNorm!')
from torch.nn import LayerNorm
from megatron import get_args
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment