Skip to content

GitLab

Commit 52504780 authored by Hongkun Yu's avatar Hongkun Yu Committed by A. Unique TensorFlower
Browse files

Remove backward compatibility hack. 

PiperOrigin-RevId: 323927843
parent b658b16d
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 6 deletions
official/nlp/modeling/layers/transformer.py
View file @ 52504780
...@@ -119,12 +119,6 @@ class Transformer(tf.keras.layers.Layer): ...@@ -119,12 +119,6 @@ class Transformer(tf.keras.layers.Layer):
dropout=self._attention_dropout_rate, dropout=self._attention_dropout_rate,
name="self_attention", name="self_attention",
**common_kwargs) **common_kwargs)
# pylint: disable=protected-access
# Temporarily handling for checkpoint compatible changes.
self._attention_layer._build_from_signature(
query=input_tensor_shape, value=input_tensor_shape)
self._attention_output_dense = self._attention_layer._output_dense
# pylint: enable=protected-access
self._attention_dropout = tf.keras.layers.Dropout(rate=self._dropout_rate) self._attention_dropout = tf.keras.layers.Dropout(rate=self._dropout_rate)
# Use float32 in layernorm for numeric stability. # Use float32 in layernorm for numeric stability.
# It is probably safe in mixed_float16, but we haven't validated this yet. # It is probably safe in mixed_float16, but we haven't validated this yet.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment