Skip to content

GitLab

Commit 1005e9d3 authored by liangjj's avatar liangjj
Browse files

update

parent 051f58f1
Pipeline #951 failed with stages
in 0 seconds
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
megatron/model/fused_layer_norm.py
View file @ 1005e9d3
...@@ -14,7 +14,7 @@ from megatron.core.utils import make_viewless_tensor ...@@ -14,7 +14,7 @@ from megatron.core.utils import make_viewless_tensor
try: try:
from apex.contrib.layer_norm.layer_norm import FastLayerNormFN from apex.contrib.layer_norm.layer_norm import FastLayerNormFN
HAVE_PERSIST_LAYER_NORM = True HAVE_PERSIST_LAYER_NORM = False
except: except:
HAVE_PERSIST_LAYER_NORM = False HAVE_PERSIST_LAYER_NORM = False
......
single.sh 100644 → 100755
View file @ 1005e9d3
File mode changed from 100644 to 100755
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment