Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ResNet50_tensorflow
Commits
6b6b3a9c
Commit
6b6b3a9c
authored
May 27, 2022
by
Scott Zhu
Committed by
A. Unique TensorFlower
May 27, 2022
Browse files
Prepare for upcoming keras initializer change.
PiperOrigin-RevId: 451475383
parent
9a3e9518
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
3 deletions
+4
-3
official/projects/teams/teams_pretrainer.py
official/projects/teams/teams_pretrainer.py
+4
-3
No files found.
official/projects/teams/teams_pretrainer.py
View file @
6b6b3a9c
...
...
@@ -58,15 +58,16 @@ class ReplacedTokenDetectionHead(tf.keras.layers.Layer):
intermediate_activation
=
self
.
activation
,
dropout_rate
=
self
.
hidden_cfg
[
'dropout_rate'
],
attention_dropout_rate
=
self
.
hidden_cfg
[
'attention_dropout_rate'
],
kernel_initializer
=
self
.
initializer
,
kernel_initializer
=
tf_utils
.
clone_initializer
(
self
.
initializer
)
,
name
=
'transformer/layer_%d_rtd'
%
i
))
self
.
dense
=
tf
.
keras
.
layers
.
Dense
(
self
.
hidden_size
,
activation
=
self
.
activation
,
kernel_initializer
=
self
.
initializer
,
kernel_initializer
=
tf_utils
.
clone_initializer
(
self
.
initializer
)
,
name
=
'transform/rtd_dense'
)
self
.
rtd_head
=
tf
.
keras
.
layers
.
Dense
(
units
=
1
,
kernel_initializer
=
self
.
initializer
,
units
=
1
,
kernel_initializer
=
tf_utils
.
clone_initializer
(
self
.
initializer
),
name
=
'transform/rtd_head'
)
if
output
not
in
(
'predictions'
,
'logits'
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment