Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into remove-dataset

1f8a8c1d · jon-tow · b4c0275d · b0acb337 · 1f8a8c1d · 1f8a8c1d
Commit 1f8a8c1d authored Jun 11, 2022 by jon-tow
20 changed files
--- a/tests/tests/testdata/blimp_drop_argument-v0-res.json
+++ b/tests/tests/testdata/blimp_drop_argument-v0-res.json
--- a/tests/tests/testdata/blimp_ellipsis_n_bar_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_ellipsis_n_bar_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_ellipsis_n_bar_1-v0-res.json
+++ b/tests/tests/testdata/blimp_ellipsis_n_bar_1-v0-res.json
--- a/tests/tests/testdata/blimp_ellipsis_n_bar_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_ellipsis_n_bar_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_ellipsis_n_bar_2-v0-res.json
+++ b/tests/tests/testdata/blimp_ellipsis_n_bar_2-v0-res.json
--- a/tests/tests/testdata/blimp_existential_there_object_raising-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_existential_there_object_raising-v0-loglikelihood
--- a/tests/tests/testdata/blimp_existential_there_object_raising-v0-res.json
+++ b/tests/tests/testdata/blimp_existential_there_object_raising-v0-res.json
--- a/tests/tests/testdata/blimp_existential_there_quantifiers_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_existential_there_quantifiers_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_existential_there_quantifiers_1-v0-res.json
+++ b/tests/tests/testdata/blimp_existential_there_quantifiers_1-v0-res.json
--- a/tests/tests/testdata/blimp_existential_there_quantifiers_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_existential_there_quantifiers_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_existential_there_quantifiers_2-v0-res.json
+++ b/tests/tests/testdata/blimp_existential_there_quantifiers_2-v0-res.json
--- a/tests/tests/testdata/blimp_existential_there_subject_raising-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_existential_there_subject_raising-v0-loglikelihood
--- a/tests/tests/testdata/blimp_existential_there_subject_raising-v0-res.json
+++ b/tests/tests/testdata/blimp_existential_there_subject_raising-v0-res.json
--- a/tests/tests/testdata/blimp_expletive_it_object_raising-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_expletive_it_object_raising-v0-loglikelihood
--- a/tests/tests/testdata/blimp_expletive_it_object_raising-v0-res.json
+++ b/tests/tests/testdata/blimp_expletive_it_object_raising-v0-res.json
--- a/tests/tests/testdata/blimp_inchoative-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_inchoative-v0-loglikelihood
--- a/tests/tests/testdata/blimp_inchoative-v0-res.json
+++ b/tests/tests/testdata/blimp_inchoative-v0-res.json
--- a/tests/tests/testdata/blimp_intransitive-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_intransitive-v0-loglikelihood
--- a/tests/tests/testdata/blimp_intransitive-v0-res.json
+++ b/tests/tests/testdata/blimp_intransitive-v0-res.json
--- a/tests/tests/testdata/blimp_irregular_past_participle_adjectives-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_irregular_past_participle_adjectives-v0-loglikelihood