Skip to content

GitLab

Commit 1005e9d3 authored by liangjj's avatar liangjj
Browse files

update

parent 051f58f1
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
megatron/model/fused_layer_norm.py
View file @ 1005e9d3
......@@ -14,7 +14,7 @@ from megatron.core.utils import make_viewless_tensor
try:
from apex.contrib.layer_norm.layer_norm import FastLayerNormFN
HAVE_PERSIST_LAYER_NORM = True
HAVE_PERSIST_LAYER_NORM = False
except:
HAVE_PERSIST_LAYER_NORM = False
......
single.sh 100644 → 100755
View file @ 1005e9d3
File mode changed from 100644 to 100755
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment