Unverified Commit 331d7c51 authored by Stella Biderman's avatar Stella Biderman Committed by GitHub
Browse files

Delete lm_eval/tasks/siqa/bigbench.yaml

parent 20463a3f
task: social_iqa
dataset_path: social_i_qa
dataset_name: null
output_type: multiple_choice
training_split: train
validation_split: validation
doc_to_text: "Q: {{context}} {{question}}\nA:"
target_delimiter: " "
doc_to_choice: ["{{answerA}}", "{{answerB}}", "{{answerC}}"]
doc_to_target: "{{label}}"
metric_list:
- metric: acc
aggregation: mean
higher_is_better: true
metadata:
- version: 0.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment