Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "8ac29fe0905c3f7f04963ef22c4f61e59ee1004a"
Unverified Commit 2582bbde authored by Arthur's avatar Arthur Committed by GitHub
Browse files

fix ACT_FN (#25627)

parent 2c1bcbf5
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/openai/modeling_openai.py
View file @ 2582bbde
......@@ -130,7 +130,7 @@ def load_tf_weights_in_openai_gpt(model, config, openai_checkpoint_folder_path):
return model
ACT_FNS = {"relu": nn.ReLU, "silu": silu, "gelu": gelu_new, "swish": silu}
ACT_FNS = {"relu": nn.ReLU(), "silu": silu, "gelu": gelu_new, "swish": silu}
class Attention(nn.Module):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment