Skip to content

GitLab

Commit 440f31ab authored by Chen Chen's avatar Chen Chen Committed by A. Unique TensorFlower
Browse files

Internal Change 

PiperOrigin-RevId: 284278191
parent 22e20f84
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
official/nlp/bert_models.py
View file @ 440f31ab
......@@ -152,7 +152,7 @@ def _get_transformer_encoder(bert_config,
num_layers=bert_config.num_hidden_layers,
num_attention_heads=bert_config.num_attention_heads,
intermediate_size=bert_config.intermediate_size,
activation=tf_utils.get_activation('gelu'),
activation=tf_utils.get_activation(bert_config.hidden_act),
dropout_rate=bert_config.hidden_dropout_prob,
attention_dropout_rate=bert_config.attention_probs_dropout_prob,
sequence_length=sequence_length,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment