Merge branch 'upstream' into 'mmlu-pro'

add tokenizer logs info (#1731) See merge request shijie.yu/lm-evaluation-harness!4

Merge branch 'upstream' into 'mmlu-pro'
add tokenizer logs info (#1731) See merge request shijie.yu/lm-evaluation-harness!4
c1e63555 · Yu Shi Jie · e361687c · 42dc2448 · c1e63555 · c1e63555
Commit c1e63555 authored Jul 24, 2024 by Yu Shi Jie
20 changed files
--- a/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_logical.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_logical.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_management.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_management.yaml
--- a/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml
+++ b/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml