Commit 9b00813f authored by haileyschoelkopf's avatar haileyschoelkopf
Browse files

fix choices

parent 620d8a36
......@@ -10,7 +10,7 @@ validation_split: validation
test_split: test
description: "The following are multiple choice questions (with answers) about abstract algebra.\n\n"
doc_to_text: "{{question.strip()}}\nA. {{choices[0]}}\nB. {{choices[1]}}\nC. {{choices[2]}}\nD. {{choices[3]}}\nAnswer:"
doc_to_choice: "{{choices}}"
doc_to_choice: ["A", "B", "C", "D"]
doc_to_target: "{{answer}}"
metric_list:
- metric: acc
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment