Skip to content

GitLab

Commit 649a7f95 authored by FarzanehNakhaee's avatar FarzanehNakhaee
Browse files

Add space for doc to text

parent 6c69e30a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/qa4mre/qa4mre_2011.yaml
View file @ 649a7f95
...@@ -6,7 +6,7 @@ dataset_name: 2011.main.EN ...@@ -6,7 +6,7 @@ dataset_name: 2011.main.EN
output_type: multiple_choice output_type: multiple_choice
test_split: train test_split: train
template_aliases: "{% set answer_choices = answer_options['answer_str'] %}" template_aliases: "{% set answer_choices = answer_options['answer_str'] %}"
doc_to_text: "{{document_str.strip()}}\nQuestion:{{question_str}}\nAnswer:" doc_to_text: "{{document_str.strip()}}\nQuestion: {{question_str}}\nAnswer:"
doc_to_target: !function preprocess_qa4mre.qa4mre_process doc_to_target: !function preprocess_qa4mre.qa4mre_process
should_decontaminate: true should_decontaminate: true
doc_to_decontamination_query: "{{document_str.strip()}} + ' ' + {{question_str}}" doc_to_decontamination_query: "{{document_str.strip()}} + ' ' + {{question_str}}"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment