Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into...

Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into evaluator-description-option

Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into...
Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into evaluator-description-option
5792030c · Leo Gao · b2f6bce8 · 8728710c · 5792030c · 5792030c
Commit 5792030c authored Jan 08, 2022 by Leo Gao
20 changed files
--- a/tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_npi_present_2-v0-res.json
+++ b/tests/tests/testdata/blimp_npi_present_2-v0-res.json
--- a/tests/tests/testdata/blimp_only_npi_licensor_present-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_only_npi_licensor_present-v0-loglikelihood
--- a/tests/tests/testdata/blimp_only_npi_licensor_present-v0-res.json
+++ b/tests/tests/testdata/blimp_only_npi_licensor_present-v0-res.json
--- a/tests/tests/testdata/blimp_only_npi_scope-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_only_npi_scope-v0-loglikelihood
--- a/tests/tests/testdata/blimp_only_npi_scope-v0-res.json
+++ b/tests/tests/testdata/blimp_only_npi_scope-v0-res.json
--- a/tests/tests/testdata/blimp_passive_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_passive_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_passive_1-v0-res.json
+++ b/tests/tests/testdata/blimp_passive_1-v0-res.json
--- a/tests/tests/testdata/blimp_passive_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_passive_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_passive_2-v0-res.json
+++ b/tests/tests/testdata/blimp_passive_2-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_c_command-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_c_command-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_case_1-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_case_1-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_case_2-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_case_2-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_1-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_1-v0-res.json
--- a/tests/tests/testdata/blimp_principle_A_domain_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_domain_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_domain_2-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_domain_2-v0-res.json