Skip to content

GitLab

Unverified Commit dc68a39c authored by Rafael Padilla's avatar Rafael Padilla Committed by GitHub
Browse files

Adding leaky relu in dict ACT2CLS (#27574) 


Co-authored-by: default avatarRafael Padilla <rafael.padilla@huggingface.co>
parent 25b0f203
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
src/transformers/activations.py
View file @ dc68a39c
...@@ -206,6 +206,7 @@ ACT2CLS = { ...@@ -206,6 +206,7 @@ ACT2CLS = {
"gelu_pytorch_tanh": PytorchGELUTanh, "gelu_pytorch_tanh": PytorchGELUTanh,
"gelu_accurate": AccurateGELUActivation, "gelu_accurate": AccurateGELUActivation,
"laplace": LaplaceActivation, "laplace": LaplaceActivation,
"leaky_relu": nn.LeakyReLU,
"linear": LinearActivation, "linear": LinearActivation,
"mish": MishActivation, "mish": MishActivation,
"quick_gelu": QuickGELUActivation, "quick_gelu": QuickGELUActivation,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment