Unverified Commit a57a7af4 authored by Aryan's avatar Aryan Committed by GitHub
Browse files

[bug] remove unreachable norm_type=ada_norm_continuous from norm3 initialization conditions (#9006)



remove ada_norm_continuous from norm3 list
Co-authored-by: default avatarSayak Paul <spsayakpaul@gmail.com>
parent 52f1378e
......@@ -376,7 +376,7 @@ class BasicTransformerBlock(nn.Module):
"layer_norm",
)
elif norm_type in ["ada_norm_zero", "ada_norm", "layer_norm", "ada_norm_continuous"]:
elif norm_type in ["ada_norm_zero", "ada_norm", "layer_norm"]:
self.norm3 = nn.LayerNorm(dim, norm_eps, norm_elementwise_affine)
elif norm_type == "layer_norm_i2vgen":
self.norm3 = None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment