lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml · 3a8f1e44434fec08a3f325d41cfcbe2843183f29 · gaoqiong / lm-evaluation-harness

"mmdet/configs/common/ms_90k_coco.py" did not exist on "3e89e2569a866545f404bfd4c11cc9bfb12cad68"

add task for mmlu evaluation in arc multiple choice format (#1745) · 9097ad3e

jonabur authored May 08, 2024



* add mmlu arc style evaluation

* rename arc_style to continuation

---------
Co-authored-by: Jonathan Burdge <jburdge@mahti-login11.mahti.csc.fi>
Co-authored-by: Jonathan Burdge <jburdge@mahti-login12.mahti.csc.fi>

9097ad3e

mmlu_miscellaneous.yaml 239 Bytes

Replace mmlu_miscellaneous.yaml