lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml · 1e2b2c4dc5400475b8a62e5fd2c909c841508524 · gaoqiong / lm-evaluation-harness

"results/paper_data/tb-ib-dumbbell-DCTCPm179712-1500-1.json" did not exist on "9f3cf8fb8036dc4c1b1cf18bb7b15ee5f5066baf"

Find file Blame History Permalink

add task for mmlu evaluation in arc multiple choice format (#1745) · 9097ad3e

jonabur authored May 08, 2024



* add mmlu arc style evaluation

* rename arc_style to continuation

---------
Co-authored-by: Jonathan Burdge <jburdge@mahti-login11.mahti.csc.fi>
Co-authored-by: Jonathan Burdge <jburdge@mahti-login12.mahti.csc.fi>

9097ad3e

mmlu_security_studies.yaml 259 Bytes

Replace mmlu_security_studies.yaml