Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
5f48dfc2
"test/git@developer.sourcefind.cn:gaoqiong/migraphx.git" did not exist on "f5329965eefc5fced4c6e864af547b5f3390a03c"
Commit
5f48dfc2
authored
Dec 21, 2021
by
Igor Ostrovsky
Browse files
Add BLiMP
parent
df5d7cf0
Changes
138
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
0 deletions
+20
-0
tests/tests/testdata/blimp_intransitive-v0-loglikelihood
tests/tests/testdata/blimp_intransitive-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_intransitive-v0-res.json
tests/tests/testdata/blimp_intransitive-v0-res.json
+1
-0
tests/tests/testdata/blimp_irregular_past_participle_adjectives-v0-loglikelihood
...imp_irregular_past_participle_adjectives-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_irregular_past_participle_adjectives-v0-res.json
...ta/blimp_irregular_past_participle_adjectives-v0-res.json
+1
-0
tests/tests/testdata/blimp_irregular_past_participle_verbs-v0-loglikelihood
...ta/blimp_irregular_past_participle_verbs-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_irregular_past_participle_verbs-v0-res.json
...estdata/blimp_irregular_past_participle_verbs-v0-res.json
+1
-0
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_1-v0-loglikelihood
...rregular_plural_subject_verb_agreement_1-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_1-v0-res.json
...imp_irregular_plural_subject_verb_agreement_1-v0-res.json
+1
-0
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-loglikelihood
...rregular_plural_subject_verb_agreement_2-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-res.json
...imp_irregular_plural_subject_verb_agreement_2-v0-res.json
+1
-0
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-loglikelihood
...a/blimp_left_branch_island_echo_question-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-res.json
...stdata/blimp_left_branch_island_echo_question-v0-res.json
+1
-0
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-loglikelihood
...blimp_left_branch_island_simple_question-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-res.json
...data/blimp_left_branch_island_simple_question-v0-res.json
+1
-0
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-loglikelihood
...imp_matrix_question_npi_licensor_present-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-res.json
...ta/blimp_matrix_question_npi_licensor_present-v0-res.json
+1
-0
tests/tests/testdata/blimp_npi_present_1-v0-loglikelihood
tests/tests/testdata/blimp_npi_present_1-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_npi_present_1-v0-res.json
tests/tests/testdata/blimp_npi_present_1-v0-res.json
+1
-0
tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_npi_present_2-v0-res.json
tests/tests/testdata/blimp_npi_present_2-v0-res.json
+1
-0
No files found.
tests/tests/testdata/blimp_intransitive-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
6469ae3b0d46b008846b5fd132f2d2b26ea2858745d056df1470b89aa97a790f
\ No newline at end of file
tests/tests/testdata/blimp_intransitive-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_intransitive"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_intransitive"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_irregular_past_participle_adjectives-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
47c56f336df11924d8b97feb46339ce55bea4b216b6fd13946cc999ea36a4a95
\ No newline at end of file
tests/tests/testdata/blimp_irregular_past_participle_adjectives-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_irregular_past_participle_adjectives"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_irregular_past_participle_adjectives"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_irregular_past_participle_verbs-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
63ec733873f94ace71cb34112d1c3cd5bb768c26b975fb90acc9b8ba3f4e938e
\ No newline at end of file
tests/tests/testdata/blimp_irregular_past_participle_verbs-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_irregular_past_participle_verbs"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_irregular_past_participle_verbs"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_1-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
7084358b1b7dd7fb5ead1a58f4b499d6f7610eca897bfac25a986d0f9a91aa5d
\ No newline at end of file
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_1-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_irregular_plural_subject_verb_agreement_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_irregular_plural_subject_verb_agreement_1"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
9534751f83a86b6cbe1fb12fb9feb827b0b7836a663108928b4ecc1d70b08871
\ No newline at end of file
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_irregular_plural_subject_verb_agreement_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_irregular_plural_subject_verb_agreement_2"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
9852b38612db8c6adf938a5d8a7a9e5ce9e655259d6cc806b142506fcaff0ed4
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_left_branch_island_echo_question"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_left_branch_island_echo_question"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
6cb36bbdae7754f8832f50872c3dd511ce12547e00fa0771deb747be3355eb85
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_left_branch_island_simple_question"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_left_branch_island_simple_question"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
a3a702a3335c79b02b36caf37c68069050c2a8a3a03c3610c09afc39d2b83fb1
\ No newline at end of file
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_matrix_question_npi_licensor_present"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_matrix_question_npi_licensor_present"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_1-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
3ef532a85e0ee8f8ff779bc7ddc873d515969a708da84a4eb4a85b7c843cf244
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_1-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_npi_present_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_1"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
0 → 100644
View file @
5f48dfc2
fdb688ac6259bb65d234ef0a36e9a9ee449f9608f633b12e1943b462aead8e17
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_2-v0-res.json
0 → 100644
View file @
5f48dfc2
{
"results"
:
{
"blimp_npi_present_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_2"
:
0
}}
\ No newline at end of file
Prev
1
2
3
4
5
6
7
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment