Internal change

PiperOrigin-RevId: 373866819

Internal change
PiperOrigin-RevId: 373866819
e04eb07b · A. Unique TensorFlower · 39464225 · e04eb07b
Commit e04eb07b authored May 14, 2021 by A. Unique TensorFlower
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

official/nlp/modeling/layers/transformer.py official/nlp/modeling/layers/transformer.py +1 -1

No files found.
--- a/official/nlp/modeling/layers/transformer.py
+++ b/official/nlp/modeling/layers/transformer.py
@@ -107,7 +107,7 @@ class Transformer(keras_nlp.layers.TransformerEncoderBlock):
        "intermediate_activation":
            self._inner_activation,
        "dropout_rate":
-            self._attention_dropout_rate,
+            self._output_dropout_rate,
        "attention_dropout_rate":
            self._attention_dropout_rate,
        "output_range":