lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml · 60c9c17081a091df4abdaf0104272d436557918c · gaoqiong / lm-evaluation-harness

"lm_eval/tasks/crows_pairs/crows_pairs_french.yaml" did not exist on "9f67a436080fce8b9d07a27fd88dadd28452539d"

add task for mmlu evaluation in arc multiple choice format (#1745) · 9097ad3e

jonabur authored May 08, 2024



* add mmlu arc style evaluation

* rename arc_style to continuation

---------
Co-authored-by: Jonathan Burdge <jburdge@mahti-login11.mahti.csc.fi>
Co-authored-by: Jonathan Burdge <jburdge@mahti-login12.mahti.csc.fi>

9097ad3e

mmlu_elementary_mathematics.yaml 266 Bytes

Replace mmlu_elementary_mathematics.yaml