Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ResNet50_tensorflow
Commits
180f2607
Commit
180f2607
authored
Jul 08, 2020
by
Chen Chen
Committed by
A. Unique TensorFlower
Jul 08, 2020
Browse files
Add a colab to explain how to use scaffold classes to build noval achitectures.
PiperOrigin-RevId: 320149378
parent
56c6c6b8
Changes
2
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
632 additions
and
8 deletions
+632
-8
official/colab/nlp/customize_encoder.ipynb
official/colab/nlp/customize_encoder.ipynb
+625
-0
official/nlp/modeling/README.md
official/nlp/modeling/README.md
+7
-8
No files found.
official/colab/nlp/customize_encoder.ipynb
0 → 100644
View file @
180f2607
This diff is collapsed.
Click to expand it.
official/nlp/modeling/README.md
View file @
180f2607
...
...
@@ -17,7 +17,8 @@ standardized configuration.
*
[
`losses`
](
losses
)
contains common loss computation used in NLP tasks.
Please see the colab
[
Introduction_to_NLP_Modeling_Library.ipynb
](
https://colab.sandbox.google.com/github/tensorflow/models/blob/master/official/colab/nlp/nlp_modeling_library_intro.ipynb
)
[nlp_modeling_library_intro.ipynb]
(https://colab.sandbox.google.com/github/tensorflow/models/blob/master/official/colab/nlp/nlp_modeling_library_intro.ipynb)
for how to build transformer-based NLP models using above primitives.
Besides the pre-defined primitives, it also provides scaffold classes to allow
...
...
@@ -37,11 +38,9 @@ embedding subnetwork (which will replace the standard embedding logic) and/or a
custom hidden layer (which will replace the Transformer instantiation in the
encoder).
BERT and ALBERT models in this repo are implemented using this library. Code examples can be found in the corresponding model folder.
Please see the colab
[customize_encoder.ipynb]
(https://colab.sandbox.google.com/github/tensorflow/models/blob/master/official/colab/nlp/customize_encoder.ipynb)
for how to use scaffold classes to build noval achitectures.
BERT and ALBERT models in this repo are implemented using this library. Code examples can be found in the corresponding model folder.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment