Add new dataset MMLU-SR tasks (#2032)

* add mmlusr tasks * renamed all tasks names in mmlusr * edit format and readme * added mmlu_sr * mmlu_sr -> mmlusr * update --------- Co-authored-by: lintangsutawika <lintang@eleuther.ai>

Add new dataset MMLU-SR tasks (#2032)
* add mmlusr tasks * renamed all tasks names in mmlusr * edit format and readme * added mmlu_sr * mmlu_sr -> mmlusr * update --------- Co-authored-by: lintangsutawika <lintang@eleuther.ai>
d5f39bf8 · SuperCat · GitHub · cdd954f9 · d5f39bf8 · d5f39bf8
Unverified Commit d5f39bf8 authored Jul 12, 2024 by SuperCat Committed by GitHub Jul 12, 2024
20 changed files
--- a/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml
--- a/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml
+++ b/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml