Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
ff58b389
"src/targets/vscode:/vscode.git/clone" did not exist on "44cc81156eaf7a9760a577b92878c71b0b5d5aa1"
Commit
ff58b389
authored
Jan 03, 2022
by
Leo Gao
Browse files
Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into bits_per_byte
parents
33315a1f
a67c17e0
Changes
150
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
0 deletions
+20
-0
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-loglikelihood
...rregular_plural_subject_verb_agreement_2-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-res.json
...imp_irregular_plural_subject_verb_agreement_2-v0-res.json
+1
-0
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-loglikelihood
...a/blimp_left_branch_island_echo_question-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-res.json
...stdata/blimp_left_branch_island_echo_question-v0-res.json
+1
-0
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-loglikelihood
...blimp_left_branch_island_simple_question-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-res.json
...data/blimp_left_branch_island_simple_question-v0-res.json
+1
-0
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-loglikelihood
...imp_matrix_question_npi_licensor_present-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-res.json
...ta/blimp_matrix_question_npi_licensor_present-v0-res.json
+1
-0
tests/tests/testdata/blimp_npi_present_1-v0-loglikelihood
tests/tests/testdata/blimp_npi_present_1-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_npi_present_1-v0-res.json
tests/tests/testdata/blimp_npi_present_1-v0-res.json
+1
-0
tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_npi_present_2-v0-res.json
tests/tests/testdata/blimp_npi_present_2-v0-res.json
+1
-0
tests/tests/testdata/blimp_only_npi_licensor_present-v0-loglikelihood
...testdata/blimp_only_npi_licensor_present-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_only_npi_licensor_present-v0-res.json
...ests/testdata/blimp_only_npi_licensor_present-v0-res.json
+1
-0
tests/tests/testdata/blimp_only_npi_scope-v0-loglikelihood
tests/tests/testdata/blimp_only_npi_scope-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_only_npi_scope-v0-res.json
tests/tests/testdata/blimp_only_npi_scope-v0-res.json
+1
-0
tests/tests/testdata/blimp_passive_1-v0-loglikelihood
tests/tests/testdata/blimp_passive_1-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_passive_1-v0-res.json
tests/tests/testdata/blimp_passive_1-v0-res.json
+1
-0
tests/tests/testdata/blimp_passive_2-v0-loglikelihood
tests/tests/testdata/blimp_passive_2-v0-loglikelihood
+1
-0
tests/tests/testdata/blimp_passive_2-v0-res.json
tests/tests/testdata/blimp_passive_2-v0-res.json
+1
-0
No files found.
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-loglikelihood
0 → 100644
View file @
ff58b389
9534751f83a86b6cbe1fb12fb9feb827b0b7836a663108928b4ecc1d70b08871
\ No newline at end of file
tests/tests/testdata/blimp_irregular_plural_subject_verb_agreement_2-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_irregular_plural_subject_verb_agreement_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_irregular_plural_subject_verb_agreement_2"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-loglikelihood
0 → 100644
View file @
ff58b389
9852b38612db8c6adf938a5d8a7a9e5ce9e655259d6cc806b142506fcaff0ed4
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_echo_question-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_left_branch_island_echo_question"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_left_branch_island_echo_question"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-loglikelihood
0 → 100644
View file @
ff58b389
6cb36bbdae7754f8832f50872c3dd511ce12547e00fa0771deb747be3355eb85
\ No newline at end of file
tests/tests/testdata/blimp_left_branch_island_simple_question-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_left_branch_island_simple_question"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_left_branch_island_simple_question"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-loglikelihood
0 → 100644
View file @
ff58b389
a3a702a3335c79b02b36caf37c68069050c2a8a3a03c3610c09afc39d2b83fb1
\ No newline at end of file
tests/tests/testdata/blimp_matrix_question_npi_licensor_present-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_matrix_question_npi_licensor_present"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_matrix_question_npi_licensor_present"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_1-v0-loglikelihood
0 → 100644
View file @
ff58b389
3ef532a85e0ee8f8ff779bc7ddc873d515969a708da84a4eb4a85b7c843cf244
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_1-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_npi_present_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_1"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_2-v0-loglikelihood
0 → 100644
View file @
ff58b389
fdb688ac6259bb65d234ef0a36e9a9ee449f9608f633b12e1943b462aead8e17
\ No newline at end of file
tests/tests/testdata/blimp_npi_present_2-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_npi_present_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_2"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_only_npi_licensor_present-v0-loglikelihood
0 → 100644
View file @
ff58b389
d2d0711611b5b218c6fa8c7278494749252b7868c396451919b761303556bd66
\ No newline at end of file
tests/tests/testdata/blimp_only_npi_licensor_present-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_only_npi_licensor_present"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_only_npi_licensor_present"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_only_npi_scope-v0-loglikelihood
0 → 100644
View file @
ff58b389
fc0be817478c212327050fa297ef61ad214f4847dbff61d4e0fe7914c06a1691
\ No newline at end of file
tests/tests/testdata/blimp_only_npi_scope-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_only_npi_scope"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_only_npi_scope"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_passive_1-v0-loglikelihood
0 → 100644
View file @
ff58b389
fa4addddd8e380031b8e0871776cabcb707c0f21dcaf5d8b3defec66cce55043
\ No newline at end of file
tests/tests/testdata/blimp_passive_1-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_passive_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_passive_1"
:
0
}}
\ No newline at end of file
tests/tests/testdata/blimp_passive_2-v0-loglikelihood
0 → 100644
View file @
ff58b389
755bdfe2c89737c43001ff1dc83d68ad33e444aaf0669af66aaf82dcd09f2eca
\ No newline at end of file
tests/tests/testdata/blimp_passive_2-v0-res.json
0 → 100644
View file @
ff58b389
{
"results"
:
{
"blimp_passive_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_passive_2"
:
0
}}
\ No newline at end of file
Prev
1
2
3
4
5
6
7
8
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment