Skip to content

GitLab

Commit b04eb0a2 authored by Boris Fomitchev's avatar Boris Fomitchev
Browse files

Warning added

parent 9026b86d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
megatron/model/transformer.py
View file @ b04eb0a2
...@@ -24,6 +24,7 @@ try: ...@@ -24,6 +24,7 @@ try:
_ = FusedLayerNorm(8, eps=1e-5) _ = FusedLayerNorm(8, eps=1e-5)
except Exception as e: except Exception as e:
print('WARNING: APEX is not available, using torch.nn.LayerNorm instead of apex.normalization.FusedLayerNorm!')
from torch.nn import LayerNorm from torch.nn import LayerNorm
from megatron import get_args from megatron import get_args
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment