Skip to content

GitLab

Commit a9bdee32 authored by Chen Chen's avatar Chen Chen Committed by A. Unique TensorFlower
Browse files

Internal change 

PiperOrigin-RevId: 317336167
parent 58e805e0
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
official/nlp/configs/encoders.py
View file @ a9bdee32
...@@ -54,6 +54,7 @@ def instantiate_encoder_from_cfg( ...@@ -54,6 +54,7 @@ def instantiate_encoder_from_cfg(
activation=tf_utils.get_activation(config.hidden_activation), activation=tf_utils.get_activation(config.hidden_activation),
dropout_rate=config.dropout_rate, dropout_rate=config.dropout_rate,
attention_dropout_rate=config.attention_dropout_rate, attention_dropout_rate=config.attention_dropout_rate,
sequence_length=None,
max_sequence_length=config.max_position_embeddings, max_sequence_length=config.max_position_embeddings,
type_vocab_size=config.type_vocab_size, type_vocab_size=config.type_vocab_size,
initializer=tf.keras.initializers.TruncatedNormal( initializer=tf.keras.initializers.TruncatedNormal(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment