Skip to content

GitLab

"build_tools/git@developer.sourcefind.cn:hehl2/torchaudio.git" did not exist on "66f4cdf9a95af341da23645f00b308d2caf9a905"
Unverified Commit f1679d7c authored by Zhu Baohe's avatar Zhu Baohe Committed by GitHub
Browse files

Fix dropout in TFMobileBert (#5150)

parent 5ed94b23
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/modeling_tf_mobilebert.py
View file @ f1679d7c
...@@ -370,7 +370,7 @@ class TFMobileBertOutput(tf.keras.layers.Layer): ...@@ -370,7 +370,7 @@ class TFMobileBertOutput(tf.keras.layers.Layer):
hidden_states = self.dense(hidden_states) hidden_states = self.dense(hidden_states)
if not self.use_bottleneck: if not self.use_bottleneck:
hidden_states = self.dropout(hidden_states) hidden_states = self.dropout(hidden_states, training=training)
hidden_states = self.LayerNorm(hidden_states + residual_tensor_1) hidden_states = self.LayerNorm(hidden_states + residual_tensor_1)
else: else:
hidden_states = self.LayerNorm(hidden_states + residual_tensor_1) hidden_states = self.LayerNorm(hidden_states + residual_tensor_1)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment