Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into bits_per_byte

ff58b389 · Leo Gao · 33315a1f · a67c17e0 · ff58b389 · ff58b389
Commit ff58b389 authored Jan 03, 2022 by Leo Gao
20 changed files
--- a/tests/tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_c_command-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_c_command-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_case_1-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_case_1-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_case_2-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_case_2-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_1-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_1-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_2-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_2-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_3-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_3-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_3-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_3-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_reconstruction-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_reconstruction-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_reconstruction-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_reconstruction-v0-res.json
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-res.json
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-res.json
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-res.json
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-res.json
--- a/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-loglikelihood
--- a/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-res.json
+++ b/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-res.json