Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ResNet50_tensorflow
Commits
9e453bbd
Commit
9e453bbd
authored
Aug 29, 2022
by
A. Unique TensorFlower
Browse files
Internal change
PiperOrigin-RevId: 470722284
parent
b39f2b43
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
18 additions
and
19 deletions
+18
-19
official/nlp/README.md
official/nlp/README.md
+18
-19
No files found.
official/nlp/README.md
View file @
9e453bbd
# TF-NLP Model Garden
⚠️ Disclaimer: All datasets hyperlinked from this page are not owned or
distributed by Google. The dataset is made available by third parties.
Please
review the terms and conditions made available by the third parties
before using
the data.
distributed by Google. The dataset is made available by third parties.
Please
review the terms and conditions made available by the third parties
before using
the data.
This codebase provides a Nat
r
ual Language Processing modeling toolkit written in
This codebase provides a Natu
r
al Language Processing modeling toolkit written in
[
TF2
](
https://www.tensorflow.org/guide/effective_tf2
)
. It allows researchers and
developers to reproduce state-of-the-art model results and train custom models
to experiment new research ideas.
## Features
*
Reusable and modularized modeling building blocks
*
State-of-the-art reproducible
*
Easy to customize and extend
*
End-to-end training
*
Distributed trainable on both GPUs and TPUs
*
Reusable and modularized modeling building blocks
*
State-of-the-art reproducible
*
Easy to customize and extend
*
End-to-end training
*
Distributed trainable on both GPUs and TPUs
## Major components
### Libraries
We provide modeling library to allow users to train custom models for new
research ideas. Detailed intructions can be found in READMEs in each folder.
research ideas. Detailed in
s
tructions can be found in READMEs in each folder.
*
[
modeling/
](
modeling
)
: modeling library that provides building blocks
(e.g.,Layers, Networks, and Models) that can be assembled into
transformer-based achitectures
.
transformer-based a
r
chitectures.
*
[
data/
](
data
)
: binaries and utils for input preprocessing, tokenization,
etc.
...
...
@@ -35,14 +35,14 @@ research ideas. Detailed intructions can be found in READMEs in each folder.
We provide SoTA model implementations, pre-trained models, training and
evaluation examples, and command lines. Detail instructions can be found in the
READMEs for specific papers. Below are some papers implemented in the
repository
and more NLP projects can be found in the
READMEs for specific papers. Below are some papers implemented in the
repository
and more NLP projects can be found in the
[
`projects`
](
https://github.com/tensorflow/models/tree/master/official/projects
)
folder:
1.
[
BERT
](
MODEL_GARDEN.md#available-model-configs
)
:
[
BERT: Pre-training of Deep
Bidirectional Transformers for
Language Understanding
](
https://arxiv.org/abs/1810.04805
)
by Devlin et al.,
2018
1.
[
BERT
](
MODEL_GARDEN.md#available-model-configs
)
:
[
BERT: Pre-training of Deep
Bidirectional Transformers for Language
Understanding
](
https://arxiv.org/abs/1810.04805
)
by Devlin et al.,
2018
2.
[
ALBERT
](
MODEL_GARDEN.md#available-model-configs
)
:
[
A Lite BERT for Self-supervised Learning of Language Representations
](
https://arxiv.org/abs/1909.11942
)
by Lan et al., 2019
...
...
@@ -56,9 +56,8 @@ folder:
### Common Training Driver
We provide a single common driver
[
train.py
](
train.py
)
to train above SoTA
models on popluar tasks. Please see
[
docs/train.md
](
docs/train.md
)
for
more details.
models on popular tasks. Please see
[
docs/train.md
](
docs/train.md
)
for more
details.
### Pre-trained models with checkpoints and TF-Hub
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment