Merge branch 'group-agg-rework' of...

Merge branch 'group-agg-rework' of https://github.com/EleutherAI/lm-evaluation-harness into multiprompt

Merge branch 'group-agg-rework' of...
Merge branch 'group-agg-rework' of https://github.com/EleutherAI/lm-evaluation-harness into multiprompt
88486e57 · lintangsutawika · 5971f2ca · ba73d131 · 88486e57 · 88486e57
Commit 88486e57 authored Jul 05, 2024 by lintangsutawika
20 changed files
--- a/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml
--- a/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml
+++ b/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml