Skip to content

GitLab

Commit ae41f67c authored by lintangsutawika's avatar lintangsutawika
Browse files

fixes to bollq

parent ce5ec854
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
lm_eval/tasks/super_glue/boolq/default.yaml
View file @ ae41f67c
...@@ -6,8 +6,10 @@ dataset_name: boolq ...@@ -6,8 +6,10 @@ dataset_name: boolq
output_type: multiple_choice output_type: multiple_choice
training_split: train training_split: train
validation_split: validation validation_split: validation
doc_to_text: "{{passage}}\nQuestion: {{question}}\nAnswer:" doc_to_text: "{{passage}}\nQuestion: {{question}}?\nAnswer:"
doc_to_target: label doc_to_target: label
doc_to_choice: {0: "no", 1: "yes"} doc_to_choice: {0: "no", 1: "yes"}
should_decontaminate: true
doc_to_decontamination_query: passage
metric_list: metric_list:
- metric: acc - metric: acc
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment