Merge branch 'upstream' into 'mmlu-pro'

add tokenizer logs info (#1731) See merge request shijie.yu/lm-evaluation-harness!4

Merge branch 'upstream' into 'mmlu-pro'
add tokenizer logs info (#1731) See merge request shijie.yu/lm-evaluation-harness!4
c1e63555 · Yu Shi Jie · e361687c · 42dc2448 · c1e63555 · c1e63555
Commit c1e63555 authored Jul 24, 2024 by Yu Shi Jie
20 changed files
--- a/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml
--- a/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml
+++ b/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml
--- a/lm_eval/tasks/mmlu/default/_default_template_yaml
+++ b/lm_eval/tasks/mmlu/default/_default_template_yaml
--- a/lm_eval/tasks/mmlu/default/_mmlu.yaml
+++ b/lm_eval/tasks/mmlu/default/_mmlu.yaml
--- a/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml
+++ b/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml
--- a/lm_eval/tasks/mmlu/default/_mmlu_other.yaml
+++ b/lm_eval/tasks/mmlu/default/_mmlu_other.yaml
--- a/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml
+++ b/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml
--- a/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml
+++ b/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml
--- a/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml
+++ b/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml
--- a/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml
+++ b/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml