Skip to content

GitLab

Commit 85d08132 authored by Hongkun Yu's avatar Hongkun Yu Committed by A. Unique TensorFlower
Browse files

Update bigbird encoder docstring to add missing args. 

PiperOrigin-RevId: 412803215
parent 68e59e15
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 0 deletions
official/nlp/projects/bigbird/encoder.py
View file @ 85d08132
...@@ -69,6 +69,10 @@ class BigBirdEncoder(tf.keras.Model): ...@@ -69,6 +69,10 @@ class BigBirdEncoder(tf.keras.Model):
embeddings. embeddings.
type_vocab_size: The number of types that the 'type_ids' input can take. type_vocab_size: The number of types that the 'type_ids' input can take.
intermediate_size: The intermediate size for the transformer layers. intermediate_size: The intermediate size for the transformer layers.
block_size: int. A BigBird Attention parameter: size of block in from/to
sequences.
num_rand_blocks: int. A BigBird Attention parameter: number of random chunks
per row.
activation: The activation to use for the transformer layers. activation: The activation to use for the transformer layers.
dropout_rate: The dropout rate to use for the transformer layers. dropout_rate: The dropout rate to use for the transformer layers.
attention_dropout_rate: The dropout rate to use for the attention layers attention_dropout_rate: The dropout rate to use for the attention layers
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment