Commit 1bc408ff authored by lintangsutawika's avatar lintangsutawika
Browse files

added rte

parent 223da391
group:
- super-glue-lm-eval-v1
task: rte
dataset_path: super_glue
dataset_name: rte
output_type: multiple_choice
training_split: train
validation_split: validation
doc_to_text: "{{sentence1}}\nQuestion: {{sentence2}} True or False?\nAnswer:"
doc_to_target: label
doc_to_choice: ['True', 'False']
metric_list:
- metric: acc
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment