Commit b4aa41f5 authored by Kaushik Shivakumar's avatar Kaushik Shivakumar
Browse files

finalize context rcnn tf2

parent eef0a1e7
...@@ -50,15 +50,16 @@ class AttentionBlock(tf.keras.layers.Layer): ...@@ -50,15 +50,16 @@ class AttentionBlock(tf.keras.layers.Layer):
"""Constructs an attention block. """Constructs an attention block.
Args: Args:
bottleneck_dimension: A int32 Tensor representing the bottleneck dimension bottleneck_dimension: A int32 Tensor representing the bottleneck dimension
for intermediate projections. for intermediate projections.
attention_temperature: A float Tensor. It controls the temperature of the attention_temperature: A float Tensor. It controls the temperature of the
softmax for weights calculation. The formula for calculation as follows: softmax for weights calculation. The formula for calculation as follows:
weights = exp(weights / temperature) / sum(exp(weights / temperature)) weights = exp(weights / temperature) / sum(exp(weights / temperature))
output_dimension: A int32 Tensor representing the last dimension of the output_dimension: A int32 Tensor representing the last dimension of the
output feature. output feature.
is_training: A boolean Tensor (affecting batch normalization). is_training: A boolean Tensor (affecting batch normalization).
name: A string describing what to name the variables in this block. name: A string describing what to name the variables in this block.
**kwargs: Additional keyword arguments.
""" """
self._key_proj = ContextProjection(bottleneck_dimension) self._key_proj = ContextProjection(bottleneck_dimension)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment