Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ResNet50_tensorflow
Commits
571369aa
Commit
571369aa
authored
Jul 08, 2020
by
A. Unique TensorFlower
Browse files
Add STS-B glue data preprocessor and regression support, and alpha-order the preprocessor classes.
PiperOrigin-RevId: 320318976
parent
7bb5ab6d
Changes
2
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
342 additions
and
285 deletions
+342
-285
official/nlp/data/classifier_data_lib.py
official/nlp/data/classifier_data_lib.py
+338
-284
official/nlp/data/create_finetuning_data.py
official/nlp/data/create_finetuning_data.py
+4
-1
No files found.
official/nlp/data/classifier_data_lib.py
View file @
571369aa
This diff is collapsed.
Click to expand it.
official/nlp/data/create_finetuning_data.py
View file @
571369aa
...
...
@@ -51,7 +51,8 @@ flags.DEFINE_string(
flags
.
DEFINE_enum
(
"classification_task_name"
,
"MNLI"
,
[
"COLA"
,
"MNLI"
,
"MRPC"
,
"PAWS-X"
,
"QNLI"
,
"QQP"
,
"RTE"
,
"SST-2"
,
"WNLI"
,
"XNLI"
,
"XTREME-XNLI"
,
"XTREME-PAWS-X"
],
"SST-2"
,
"STS-B"
,
"WNLI"
,
"XNLI"
,
"XTREME-XNLI"
,
"XTREME-PAWS-X"
],
"The name of the task to train BERT classifier. The "
"difference between XTREME-XNLI and XNLI is: 1. the format "
"of input tsv files; 2. the dev set for XTREME is english "
...
...
@@ -187,6 +188,8 @@ def generate_classifier_dataset():
"rte"
:
classifier_data_lib
.
RteProcessor
,
"sst-2"
:
classifier_data_lib
.
SstProcessor
,
"sts-b"
:
classifier_data_lib
.
StsBProcessor
,
"xnli"
:
functools
.
partial
(
classifier_data_lib
.
XnliProcessor
,
language
=
FLAGS
.
xnli_language
),
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment