Merge pull request #237 from igor0/blimp

Add BLiMP

Merge pull request #237 from igor0/blimp
Add BLiMP
f16e8b5c · Leo Gao · GitHub · 66fffcfc · 5f48dfc2 · f16e8b5c
Unverified Commit f16e8b5c authored Dec 23, 2021 by Leo Gao Committed by GitHub Dec 23, 2021
20 changed files
--- a/tests/tests/testdata/blimp_principle_A_reconstruction-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_principle_A_reconstruction-v0-loglikelihood
--- a/tests/tests/testdata/blimp_principle_A_reconstruction-v0-res.json
+++ b/tests/tests/testdata/blimp_principle_A_reconstruction-v0-res.json
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-res.json
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_1-v0-res.json
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-res.json
+++ b/tests/tests/testdata/blimp_regular_plural_subject_verb_agreement_2-v0-res.json
--- a/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-loglikelihood
--- a/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-res.json
+++ b/tests/tests/testdata/blimp_sentential_negation_npi_licensor_present-v0-res.json
--- a/tests/tests/testdata/blimp_sentential_negation_npi_scope-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_sentential_negation_npi_scope-v0-loglikelihood
--- a/tests/tests/testdata/blimp_sentential_negation_npi_scope-v0-res.json
+++ b/tests/tests/testdata/blimp_sentential_negation_npi_scope-v0-res.json
--- a/tests/tests/testdata/blimp_sentential_subject_island-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_sentential_subject_island-v0-loglikelihood
--- a/tests/tests/testdata/blimp_sentential_subject_island-v0-res.json
+++ b/tests/tests/testdata/blimp_sentential_subject_island-v0-res.json
--- a/tests/tests/testdata/blimp_superlative_quantifiers_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_superlative_quantifiers_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_superlative_quantifiers_1-v0-res.json
+++ b/tests/tests/testdata/blimp_superlative_quantifiers_1-v0-res.json
--- a/tests/tests/testdata/blimp_superlative_quantifiers_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_superlative_quantifiers_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_superlative_quantifiers_2-v0-res.json
+++ b/tests/tests/testdata/blimp_superlative_quantifiers_2-v0-res.json
--- a/tests/tests/testdata/blimp_tough_vs_raising_1-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_tough_vs_raising_1-v0-loglikelihood
--- a/tests/tests/testdata/blimp_tough_vs_raising_1-v0-res.json
+++ b/tests/tests/testdata/blimp_tough_vs_raising_1-v0-res.json
--- a/tests/tests/testdata/blimp_tough_vs_raising_2-v0-loglikelihood
+++ b/tests/tests/testdata/blimp_tough_vs_raising_2-v0-loglikelihood
--- a/tests/tests/testdata/blimp_tough_vs_raising_2-v0-res.json
+++ b/tests/tests/testdata/blimp_tough_vs_raising_2-v0-res.json