Skip to content

GitLab

Unverified Commit 3f0ef80b authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

Update siqa.yaml (#1909)

parent 923852b0
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 4 deletions
lm_eval/tasks/siqa/siqa.yaml
View file @ 3f0ef80b
...@@ -6,10 +6,7 @@ training_split: train ...@@ -6,10 +6,7 @@ training_split: train
validation_split: validation validation_split: validation
doc_to_text: "Q: {{context}} {{question}}\nA:" doc_to_text: "Q: {{context}} {{question}}\nA:"
target_delimiter: " " target_delimiter: " "
doc_to_choice: doc_to_choice: "{{[answerA, answerB, answerC]}}"
- "{{answerA}}"
- "{{answerB}}"
- "{{answerC}}"
doc_to_target: "{{ (label|int) - 1 }}" doc_to_target: "{{ (label|int) - 1 }}"
metric_list: metric_list:
- metric: acc - metric: acc
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment