Commit 32309b8b authored by A. Unique TensorFlower's avatar A. Unique TensorFlower
Browse files

Internal change

PiperOrigin-RevId: 329321442
parent 999fd0f5
...@@ -5,7 +5,7 @@ encapsulates common network structures like a classification head ...@@ -5,7 +5,7 @@ encapsulates common network structures like a classification head
or a transformer encoder into an easily handled object with a or a transformer encoder into an easily handled object with a
standardized configuration. standardized configuration.
* [`TransformerEncoder`](transformer_encoder.py) implements a bi-directional * [`BertEncoder`](bert_encoder.py) implements a bi-directional
Transformer-based encoder as described in ["BERT: Pre-training of Deep Transformer-based encoder as described in ["BERT: Pre-training of Deep
Bidirectional Transformers for Language Understanding"](https://arxiv.org/abs/1810.04805). It includes the embedding lookups, Bidirectional Transformers for Language Understanding"](https://arxiv.org/abs/1810.04805). It includes the embedding lookups,
transformer layers and pooling layer. transformer layers and pooling layer.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment