Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into task-guide

4d147bdd · Jonathan Tow · 011cc891 · dc937d4b · 4d147bdd · 4d147bdd
Commit 4d147bdd authored Sep 17, 2021 by Jonathan Tow
20 changed files
--- a/tests/testdata/coqa-v0-res.json
+++ b/tests/testdata/coqa-v0-res.json
--- a/tests/testdata/coqa-v1-greedy_until
+++ b/tests/testdata/coqa-v1-greedy_until
--- a/tests/testdata/coqa-v1-res.json
+++ b/tests/testdata/coqa-v1-res.json
--- a/tests/testdata/cycle_letters-v0-greedy_until
+++ b/tests/testdata/cycle_letters-v0-greedy_until
--- a/tests/testdata/cycle_letters-v0-res.json
+++ b/tests/testdata/cycle_letters-v0-res.json
--- a/tests/testdata/drop-v0-greedy_until
+++ b/tests/testdata/drop-v0-greedy_until
--- a/tests/testdata/drop-v0-res.json
+++ b/tests/testdata/drop-v0-res.json
--- a/tests/testdata/drop-v1-greedy_until
+++ b/tests/testdata/drop-v1-greedy_until
--- a/tests/testdata/drop-v1-res.json
+++ b/tests/testdata/drop-v1-res.json
--- a/tests/testdata/ethics_cm-v0-loglikelihood
+++ b/tests/testdata/ethics_cm-v0-loglikelihood
--- a/tests/testdata/ethics_cm-v0-res.json
+++ b/tests/testdata/ethics_cm-v0-res.json
--- a/tests/testdata/ethics_deontology-v0-loglikelihood
+++ b/tests/testdata/ethics_deontology-v0-loglikelihood
--- a/tests/testdata/ethics_deontology-v0-res.json
+++ b/tests/testdata/ethics_deontology-v0-res.json
--- a/tests/testdata/ethics_justice-v0-loglikelihood
+++ b/tests/testdata/ethics_justice-v0-loglikelihood
--- a/tests/testdata/ethics_justice-v0-res.json
+++ b/tests/testdata/ethics_justice-v0-res.json
--- a/tests/testdata/ethics_utilitarianism-v0-loglikelihood
+++ b/tests/testdata/ethics_utilitarianism-v0-loglikelihood
--- a/tests/testdata/ethics_utilitarianism-v0-res.json
+++ b/tests/testdata/ethics_utilitarianism-v0-res.json
--- a/tests/testdata/ethics_utilitarianism_original-v0-loglikelihood
+++ b/tests/testdata/ethics_utilitarianism_original-v0-loglikelihood
--- a/tests/testdata/ethics_utilitarianism_original-v0-res.json
+++ b/tests/testdata/ethics_utilitarianism_original-v0-res.json
--- a/tests/testdata/ethics_virtue-v0-loglikelihood
+++ b/tests/testdata/ethics_virtue-v0-loglikelihood