Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into task-guide

4d147bdd · Jonathan Tow · 011cc891 · dc937d4b · 4d147bdd · 4d147bdd
Commit 4d147bdd authored Sep 17, 2021 by Jonathan Tow
20 changed files
--- a/tests/testdata/hendrycksTest-high_school_government_and_politics-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_government_and_politics-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_macroeconomics-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_macroeconomics-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_macroeconomics-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_macroeconomics-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_mathematics-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_mathematics-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_mathematics-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_mathematics-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_microeconomics-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_microeconomics-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_microeconomics-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_microeconomics-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_physics-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_physics-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_physics-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_physics-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_psychology-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_psychology-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_psychology-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_psychology-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_statistics-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_statistics-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_statistics-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_statistics-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_us_history-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_us_history-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_us_history-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_us_history-v0-res.json
--- a/tests/testdata/hendrycksTest-high_school_world_history-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-high_school_world_history-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-high_school_world_history-v0-res.json
+++ b/tests/testdata/hendrycksTest-high_school_world_history-v0-res.json
--- a/tests/testdata/hendrycksTest-human_aging-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-human_aging-v0-loglikelihood
--- a/tests/testdata/hendrycksTest-human_aging-v0-res.json
+++ b/tests/testdata/hendrycksTest-human_aging-v0-res.json
--- a/tests/testdata/hendrycksTest-human_sexuality-v0-loglikelihood
+++ b/tests/testdata/hendrycksTest-human_sexuality-v0-loglikelihood