Skip to content

GitLab

Commit af3fbe03 authored by lintangsutawika's avatar lintangsutawika
Browse files

forgot to add doc_to_choice

parent cf96455a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
lm_eval/tasks/xstorycloze/default_ar.yaml
View file @ af3fbe03
...@@ -7,6 +7,7 @@ training_split: train ...@@ -7,6 +7,7 @@ training_split: train
validation_split: eval validation_split: eval
doc_to_text: "{{[input_sentence_1, input_sentence_2, input_sentence_3, input_sentence_4]|join(' ')}}" doc_to_text: "{{[input_sentence_1, input_sentence_2, input_sentence_3, input_sentence_4]|join(' ')}}"
doc_to_target: "{{answer_right_ending-1}}" doc_to_target: "{{answer_right_ending-1}}"
doc_to_choice: {{[sentence_quiz1, sentence_quiz2]}}
should_decontaminate: true should_decontaminate: true
doc_to_decontamination_query: "{{[input_sentence_1, input_sentence_2, input_sentence_3, input_sentence_4]|join(' ')}}" doc_to_decontamination_query: "{{[input_sentence_1, input_sentence_2, input_sentence_3, input_sentence_4]|join(' ')}}"
metric_list: metric_list:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment