Unverified Commit 057dc2d7 authored by Baber Abbasi's avatar Baber Abbasi Committed by GitHub
Browse files

`qqp`, `mnli_mismatch`: remove unlabled test sets (#1114)

* remove unlabled test sets

* add note to readme
parent 9ef853ac
# GLUE # GLUE
**NOTE**: GLUE benchmark tasks do not provide publicly accessible labels for their test sets, so we default to the validation sets for all sub-tasks.
### Paper ### Paper
......
include: default.yaml include: default.yaml
task: mnli_mismatch task: mnli_mismatch
validation_split: validation_mismatched validation_split: validation_mismatched
test_split: test_mismatched
...@@ -5,7 +5,6 @@ dataset_name: qqp ...@@ -5,7 +5,6 @@ dataset_name: qqp
output_type: multiple_choice output_type: multiple_choice
training_split: train training_split: train
validation_split: validation validation_split: validation
test_split: test
doc_to_text: "\nSentence 1: {{question1}}\nSentence 2: {{question2}}\nAnswer:" doc_to_text: "\nSentence 1: {{question1}}\nSentence 2: {{question2}}\nAnswer:"
doc_to_target: label doc_to_target: label
doc_to_choice: ["no", "yes"] doc_to_choice: ["no", "yes"]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment