Merge branch 'big-refactor' into cont-metrics

ccca64f7 · Lintang Sutawika · GitHub · 0a39d055 · b7a4ea06 · ccca64f7
Unverified Commit ccca64f7 authored Nov 07, 2023 by Lintang Sutawika Committed by GitHub Nov 07, 2023
4 changed files
--- a/lm_eval/tasks/mmlu/flan_n_shot/mmlu_log_us_foreign_policy.yaml
+++ b/lm_eval/tasks/mmlu/flan_n_shot/mmlu_log_us_foreign_policy.yaml
--- a/lm_eval/tasks/mmlu/flan_n_shot/mmlu_log_virology.yaml
+++ b/lm_eval/tasks/mmlu/flan_n_shot/mmlu_log_virology.yaml
--- a/lm_eval/tasks/mmlu/flan_n_shot/mmlu_log_world_religions.yaml
+++ b/lm_eval/tasks/mmlu/flan_n_shot/mmlu_log_world_religions.yaml
--- a/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py
+++ b/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py