lm_eval/tasks/kmmlu/_default_kmmlu_yaml · 12f2c5ea15d793b7f1aa8f3611ccc8db5eb1a9a5 · gaoqiong / lm-evaluation-harness · GitLab

"results/paper_data/tb-ib-dumbbell-DCTCPm91520-1500-1.json" did not exist on "9f3cf8fb8036dc4c1b1cf18bb7b15ee5f5066baf"

Find file Blame History Permalink

Error in --num_fewshot option for K-MMLU Evaluation Harness (#1178) · 12f2c5ea
GUIJIN SON authored Dec 21, 2023
```
* update kmmlu default formatting

* Update _default_kmmlu_yaml

* Delete lm_eval/tasks/kmmlu/utils.py
```
12f2c5ea

_default_kmmlu_yaml 539 Bytes