feat: Add mmlu-redux and it's spanish transaltion as generative task definitions (#2705)

* Added benchmark

* Added more testing

* Added task definition for mmlu_redux and mmlu_redux_spanish

* Add MMLU Redux English and Spanish tasks with YAML fixes and READMEs

* Add remaining MMLU Redux YAMLs and updated tasks README

* Add MMLU Redux English and Spanish tasks with YAML fixes and READMEs

* Add MMLU Redux changes from pr-2705

* Resolve pre-commit hook and pytest overlapping group issues by adding mmlu_redux_spanish task entries and unique subgroup names

* Enhance retry logic to prevent 429 error when using Hugging Face API for tests, apply pre-commit fixes

* Revert python test changes and comments one task group to avoid Hugging Face rate limit and task failure

---------
Co-authored-by: CT-6282 <ricardo.godric@hotmail.com>

lm_eval/tasks/mmlu-redux-spanish/README.md

+# Task-name
+
+### Paper
+
+Title: `Are We Donewith MMLU?`
+
+Abstract: `https://arxiv.org/pdf/2406.04127`
+
+`The test covers 57 tasks including elementary mathematics, US history, computer science, law, and more, in Spanish`
+
+Homepage: `https://huggingface.co/datasets/edinburgh-dawg/mmlu-redux-2.0`
+
+### Citation
+
+```
+BibTeX
+@misc{edinburgh2024mmlu,
+      title={Are We Done with MMLU?},
+      author={Aryo Pradipta Gema and Joshua Ong Jun Leang and Giwon Hong and Alessio Devoto and
+      Alberto Carlo Maria Mancino and Rohit Saxena and Xuanli He and Yu Zhao and Xiaotang Du and
+      MohammadRezaGhasemi Madani and Claire Barale and Robert McHardy and Joshua Harris and
+      Jean Kaddour and Emile van Krieken and Pasquale Minervini},
+      year={2025},
+      eprint={2406.04127},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL}
+}
+```
+
+### Groups, Tags, and Tasks
+
+#### Groups
+
+- `stem`
+- `other`
+- `social sciences`
+- `humanities`
+
+#### Tasks
+
+- `mmlu_stem_generative_spanish`
+- `mmlu_other_generative_spanish`
+- `mmlu_social_sciences_generative_spanish`
+- `mmlu_humanities_generative_spanish`
+
+### Checklist
+
+For adding novel benchmarks/datasets to the library:
+
+- [x] Is the task an existing benchmark in the literature?
+  - [x] Have you referenced the original paper that introduced the task?
+  - [x] If yes, does the original paper provide a reference implementation? If so, have you checked against the reference implementation and documented how to run such a test?
+
+If other tasks on this dataset are already supported:
+
+- [ ] Is the "Main" variant of this task clearly denoted?
+- [ ] Have you provided a short sentence in a README on what each new variant adds / evaluates?
+- [ ] Have you noted which, if any, published evaluation setups are matched by this variant?
+
+ver 1: PR #2705
+First implementation

lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml

+dataset_path: "amias-mx/mmlu-redux-2.0-spanish"
+test_split: test
+dataset_kwargs:
+  trust_remote_code: true
+output_type: generate_until
+doc_to_text: "{{question.strip()}}\nA. {{choices[0]}}\nB. {{choices[1]}}\nC. {{choices[2]}}\nD. {{choices[3]}}\nPor favor, responde con la letra correcta (A, B, C o D) sin absolutamente nada adicional, solo la letra correcta:"
+doc_to_target: "{{['A','B','C','D'][answer]}}"
+target_delimiter: ":"
+generation_kwargs:
+  until:
+    - "</s>"
+metric_list:
+  - metric: exact_match
+    aggregation: mean
+    higher_is_better: true
+    ignore_case: true
+    ignore_punctuation: true
+filter_list:
+  - name: default
+    filter:
+      - function: regex
+        regex_pattern: "([ABCD])"
+      - function: take_first
+metadata:
+  version: 3.0

lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml

+group: mmlu_redux_spanish_generative
+group_alias: mmlu_redux_spanish (generative)
+task:
+  - group: stem_spanish
+    task:
+      - mmlu_stem_generative_spanish
+    aggregate_metric_list:
+      - metric: exact_match
+        weight_by_size: true
+  - group: other_spanish
+    task:
+      - mmlu_other_generative_spanish
+    aggregate_metric_list:
+      - metric: exact_match
+        weight_by_size: true
+  - group: social sciences_spanish
+    task:
+      - mmlu_social_sciences_generative_spanish
+    aggregate_metric_list:
+      - metric: exact_match
+        weight_by_size: true
+#  - group: humanities_spanish
+#    task:
+#      - mmlu_humanities_generative_spanish
+#    aggregate_metric_list:
+#      - metric: exact_match
+#        weight_by_size: true
+aggregate_metric_list:
+  - aggregation: mean
+    metric: exact_match
+    weight_by_size: true
+metadata:
+  version: 3

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml

+"dataset_name": "abstract_algebra"
+"description":
+  "The following are multiple choice questions (with answers) about abstract\
+  \ algebra.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_abstract_algebra_generative_spanish"
+"task_alias": "abstract_algebra_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml

+"dataset_name": "anatomy"
+"description":
+  "The following are multiple choice questions (with answers) about anatomy.\n\
+  \n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_anatomy_generative_spanish"
+"task_alias": "anatomy_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml

+"dataset_name": "astronomy"
+"description":
+  "The following are multiple choice questions (with answers) about astronomy.\n\
+  \n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_astronomy_generative_spanish"
+"task_alias": "astronomy_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml

+"dataset_name": "business_ethics"
+"description":
+  "The following are multiple choice questions (with answers) about business\
+  \ ethics.\n\n"
+"tag": "mmlu_other_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_business_ethics_generative_spanish"
+"task_alias": "business_ethics_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml

+"dataset_name": "clinical_knowledge"
+"description":
+  "The following are multiple choice questions (with answers) about clinical\
+  \ knowledge.\n\n"
+"tag": "mmlu_other_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_clinical_knowledge_generative_spanish"
+"task_alias": "clinical_knowledge_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml

+"dataset_name": "college_biology"
+"description":
+  "The following are multiple choice questions (with answers) about college\
+  \ biology.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_college_biology_generative_spanish"
+"task_alias": "college_biology_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml

+"dataset_name": "college_chemistry"
+"description":
+  "The following are multiple choice questions (with answers) about college\
+  \ chemistry.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_college_chemistry_generative_spanish"
+"task_alias": "college_chemistry_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml

+"dataset_name": "college_computer_science"
+"description":
+  "The following are multiple choice questions (with answers) about college\
+  \ computer science.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_college_computer_science_generative_spanish"
+"task_alias": "college_computer_science_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml

+"dataset_name": "college_mathematics"
+"description":
+  "The following are multiple choice questions (with answers) about college\
+  \ mathematics.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_college_mathematics_generative_spanish"
+"task_alias": "college_mathematics_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml

+"dataset_name": "college_medicine"
+"description":
+  "The following are multiple choice questions (with answers) about college\
+  \ medicine.\n\n"
+"tag": "mmlu_other_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_college_medicine_generative_spanish"
+"task_alias": "college_medicine_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml

+"dataset_name": "college_physics"
+"description":
+  "The following are multiple choice questions (with answers) about college\
+  \ physics.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_college_physics_generative_spanish"
+"task_alias": "college_physics_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml

+"dataset_name": "computer_security"
+"description":
+  "The following are multiple choice questions (with answers) about computer\
+  \ security.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_computer_security_generative_spanish"
+"task_alias": "computer_security_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml

+"dataset_name": "conceptual_physics"
+"description":
+  "The following are multiple choice questions (with answers) about conceptual\
+  \ physics.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_conceptual_physics_generative_spanish"
+"task_alias": "conceptual_physics_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml

+"dataset_name": "econometrics"
+"description":
+  "The following are multiple choice questions (with answers) about econometrics.\n\
+  \n"
+"tag": "mmlu_social_sciences_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_econometrics_generative_spanish"
+"task_alias": "econometrics_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml

+"dataset_name": "electrical_engineering"
+"description":
+  "The following are multiple choice questions (with answers) about electrical\
+  \ engineering.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_electrical_engineering_generative_spanish"
+"task_alias": "electrical_engineering_spanish"

lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml

+"dataset_name": "elementary_mathematics"
+"description":
+  "The following are multiple choice questions (with answers) about elementary\
+  \ mathematics.\n\n"
+"tag": "mmlu_stem_generative_spanish"
+"include": "_default_template_spanish_yaml"
+"task": "mmlu_elementary_mathematics_generative_spanish"
+"task_alias": "elementary_mathematics_spanish"