Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into remove-dataset

1f8a8c1d · jon-tow · b4c0275d · b0acb337 · 1f8a8c1d · 1f8a8c1d
Commit 1f8a8c1d authored Jun 11, 2022 by jon-tow
20 changed files
--- a/tests/tests/testdata/blimp_only_npi_scope-v0-res.json
+++ b/tests/tests/testdata/blimp_only_npi_scope-v0-res.json
--- a/tests/tests/testdata/blimp_passive_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_passive_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_passive_1-v0-res.json
+++ b/tests/tests/testdata/blimp_passive_1-v0-res.json
--- a/tests/tests/testdata/blimp_passive_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_passive_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_passive_2-v0-res.json
+++ b/tests/tests/testdata/blimp_passive_2-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_c_command-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_c_command-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_case_1-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_case_1-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_case_2-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_case_2-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_1-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_1-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_2-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_2-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_3-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_3-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_3-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_3-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_reconstruction-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_reconstruction-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_reconstruction-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_reconstruction-v0-res.json
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-loglikelihood