Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into remove-dataset

1f8a8c1d · jon-tow · b4c0275d · b0acb337 · 1f8a8c1d · 1f8a8c1d
Commit 1f8a8c1d authored Jun 11, 2022 by jon-tow
15 changed files
--- a/tests/tests/testdata/blimp_wh_island-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_island-v0-res.json
--- a/tests/tests/testdata/blimp_wh_questions_object_gap-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_wh_questions_object_gap-v0-loglikelihood
--- a/tests/tests/testdata/blimp_wh_questions_object_gap-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_questions_object_gap-v0-res.json
--- a/tests/tests/testdata/blimp_wh_questions_subject_gap-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_wh_questions_subject_gap-v0-loglikelihood
--- a/tests/tests/testdata/blimp_wh_questions_subject_gap-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_questions_subject_gap-v0-res.json
--- a/tests/tests/testdata/blimp_wh_questions_subject_gap_long_distance-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_wh_questions_subject_gap_long_distance-v0-loglikelihood
--- a/tests/tests/testdata/blimp_wh_questions_subject_gap_long_distance-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_questions_subject_gap_long_distance-v0-res.json
--- a/tests/tests/testdata/blimp_wh_vs_that_no_gap-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_wh_vs_that_no_gap-v0-loglikelihood
--- a/tests/tests/testdata/blimp_wh_vs_that_no_gap-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_vs_that_no_gap-v0-res.json
--- a/tests/tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-loglikelihood
--- a/tests/tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-res.json
--- a/tests/tests/testdata/blimp_wh_vs_that_with_gap-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_wh_vs_that_with_gap-v0-loglikelihood
--- a/tests/tests/testdata/blimp_wh_vs_that_with_gap-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_vs_that_with_gap-v0-res.json
--- a/tests/tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
--- a/tests/tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
+++ b/tests/tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json