Skip to content

GitLab

Commit a84c102b authored by Baber's avatar Baber
Browse files

add ai2d doc_to_image

parent 9d5ea23b
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
lm_eval/tasks/ai2d/ai2d.yaml
View file @ a84c102b
...@@ -5,6 +5,8 @@ test_split: test ...@@ -5,6 +5,8 @@ test_split: test
doc_to_text: "<image> Question: {{question}}\nAnswer:" doc_to_text: "<image> Question: {{question}}\nAnswer:"
doc_to_target: "answer" doc_to_target: "answer"
doc_to_choice: "{{options}}" doc_to_choice: "{{options}}"
doc_to_image:
- image
metric_list: metric_list:
- metric: acc - metric: acc
aggregation: mean aggregation: mean
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment