lm_eval/tasks/mmlu_pro/README.md · af8b87ccfec4438a3f77b3416d85d53363695224 · gaoqiong / lm-evaluation-harness

Increase default max_gen_toks to 2048 and max_length to 8192 for MMLU Pro tests (#2824) · 8850ebc0

dazipe authored Mar 28, 2025

* Changed default max_length from 2048 to 8192 and max_gen_toks from 256 to 2048 fro MMLU Pro tasks.

* Update lm_eval/tasks/mmlu_pro/_default_template_yaml

* pre-commit

* nit

---------

8850ebc0

README.md 4.22 KB

Replace README.md