Skip to content

GitLab

Commit c6259cf7 authored by Baber's avatar Baber
Browse files

doc_to_image is list[img]

parent b27bc18e
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
lm_eval/tasks/mathvista/mathvista.yaml
View file @ c6259cf7
...@@ -3,7 +3,8 @@ task: mathvista ...@@ -3,7 +3,8 @@ task: mathvista
test_split: testmini test_split: testmini
output_type: "generate_until" output_type: "generate_until"
#process_docs: !function utils.process_docs #process_docs: !function utils.process_docs
doc_to_image: decoded_image doc_to_image:
- decoded_image
doc_to_text: "<image> {{query}}" doc_to_text: "<image> {{query}}"
#doc_to_choice: '{{ ["A", "B", "C", "D", "E", "F"][:choices.length] }}' #doc_to_choice: '{{ ["A", "B", "C", "D", "E", "F"][:choices.length] }}'
doc_to_target: answer doc_to_target: answer
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment