lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml · 9bd948df0d4d2f3503bbcbf2e78091cf2881e1fa · gaoqiong / lm-evaluation-harness

"Keras/keras-cv/keras_cv/models/mlp_mixer.py" did not exist on "9846958aa60286f18e9741dc2b0c1e325aaa832a"

add task for mmlu evaluation in arc multiple choice format (#1745) · 9097ad3e

jonabur authored May 08, 2024



* add mmlu arc style evaluation

* rename arc_style to continuation

---------
Co-authored-by: Jonathan Burdge <jburdge@mahti-login11.mahti.csc.fi>
Co-authored-by: Jonathan Burdge <jburdge@mahti-login12.mahti.csc.fi>

9097ad3e

mmlu_prehistory.yaml 235 Bytes

Replace mmlu_prehistory.yaml