"vscode:/vscode.git/clone" did not exist on "02af9bb524030d1a133d7380207fbe6776865289"
Commit 5dd41ebe authored by lintangsutawika's avatar lintangsutawika
Browse files

fixes and added decontaminate args

parent f2b52d26
......@@ -7,9 +7,11 @@ output_type: multiple_choice
training_split: train
validation_split: validation
test_split: null
doc_to_text: "Question: {{question}}\nAnswer:"
doc_to_text: "Question: {{goal}}\nAnswer:"
doc_to_target: label
doc_to_choice: "{{[sol1, sol2]}}"
should_decontaminate: true
doc_to_decontamination_query: goal
metric_list:
- metric: acc
aggregation: mean
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment