Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
8c997e53
Commit
8c997e53
authored
May 03, 2022
by
jon-tow
Browse files
Revert `tests/testdata` changes and address flake8 issues
parent
d95a4333
Changes
627
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/blimp_matrix_question_npi_licensor_present-v0-res.json
...ta/blimp_matrix_question_npi_licensor_present-v0-res.json
+1
-1
tests/testdata/blimp_npi_present_1-v0-loglikelihood
tests/testdata/blimp_npi_present_1-v0-loglikelihood
+1
-1
tests/testdata/blimp_npi_present_1-v0-res.json
tests/testdata/blimp_npi_present_1-v0-res.json
+1
-1
tests/testdata/blimp_npi_present_2-v0-loglikelihood
tests/testdata/blimp_npi_present_2-v0-loglikelihood
+1
-1
tests/testdata/blimp_npi_present_2-v0-res.json
tests/testdata/blimp_npi_present_2-v0-res.json
+1
-1
tests/testdata/blimp_only_npi_licensor_present-v0-loglikelihood
...testdata/blimp_only_npi_licensor_present-v0-loglikelihood
+1
-1
tests/testdata/blimp_only_npi_licensor_present-v0-res.json
tests/testdata/blimp_only_npi_licensor_present-v0-res.json
+1
-1
tests/testdata/blimp_only_npi_scope-v0-loglikelihood
tests/testdata/blimp_only_npi_scope-v0-loglikelihood
+1
-1
tests/testdata/blimp_only_npi_scope-v0-res.json
tests/testdata/blimp_only_npi_scope-v0-res.json
+1
-1
tests/testdata/blimp_passive_1-v0-loglikelihood
tests/testdata/blimp_passive_1-v0-loglikelihood
+1
-1
tests/testdata/blimp_passive_1-v0-res.json
tests/testdata/blimp_passive_1-v0-res.json
+1
-1
tests/testdata/blimp_passive_2-v0-loglikelihood
tests/testdata/blimp_passive_2-v0-loglikelihood
+1
-1
tests/testdata/blimp_passive_2-v0-res.json
tests/testdata/blimp_passive_2-v0-res.json
+1
-1
tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
+1
-1
tests/testdata/blimp_principle_A_c_command-v0-res.json
tests/testdata/blimp_principle_A_c_command-v0-res.json
+1
-1
tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
+1
-1
tests/testdata/blimp_principle_A_case_1-v0-res.json
tests/testdata/blimp_principle_A_case_1-v0-res.json
+1
-1
tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
+1
-1
tests/testdata/blimp_principle_A_case_2-v0-res.json
tests/testdata/blimp_principle_A_case_2-v0-res.json
+1
-1
tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
+1
-1
No files found.
tests/
tests/
testdata/blimp_matrix_question_npi_licensor_present-v0-res.json
→
tests/testdata/blimp_matrix_question_npi_licensor_present-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_matrix_question_npi_licensor_present"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_matrix_question_npi_licensor_present"
:
0
}}
{
"results"
:
{
"blimp_matrix_question_npi_licensor_present"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_matrix_question_npi_licensor_present"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_npi_present_1-v0-loglikelihood
→
tests/testdata/blimp_npi_present_1-v0-loglikelihood
View file @
8c997e53
3ef532a85e0ee8f8ff779bc7ddc873d515969a708da84a4eb4a85b7c843cf244
3ef532a85e0ee8f8ff779bc7ddc873d515969a708da84a4eb4a85b7c843cf244
\ No newline at end of file
tests/
tests/
testdata/blimp_npi_present_1-v0-res.json
→
tests/testdata/blimp_npi_present_1-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_npi_present_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_1"
:
0
}}
{
"results"
:
{
"blimp_npi_present_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_1"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_npi_present_2-v0-loglikelihood
→
tests/testdata/blimp_npi_present_2-v0-loglikelihood
View file @
8c997e53
fdb688ac6259bb65d234ef0a36e9a9ee449f9608f633b12e1943b462aead8e17
fdb688ac6259bb65d234ef0a36e9a9ee449f9608f633b12e1943b462aead8e17
\ No newline at end of file
tests/
tests/
testdata/blimp_npi_present_2-v0-res.json
→
tests/testdata/blimp_npi_present_2-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_npi_present_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_2"
:
0
}}
{
"results"
:
{
"blimp_npi_present_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_npi_present_2"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_only_npi_licensor_present-v0-loglikelihood
→
tests/testdata/blimp_only_npi_licensor_present-v0-loglikelihood
View file @
8c997e53
d2d0711611b5b218c6fa8c7278494749252b7868c396451919b761303556bd66
d2d0711611b5b218c6fa8c7278494749252b7868c396451919b761303556bd66
\ No newline at end of file
tests/
tests/
testdata/blimp_only_npi_licensor_present-v0-res.json
→
tests/testdata/blimp_only_npi_licensor_present-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_only_npi_licensor_present"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_only_npi_licensor_present"
:
0
}}
{
"results"
:
{
"blimp_only_npi_licensor_present"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_only_npi_licensor_present"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_only_npi_scope-v0-loglikelihood
→
tests/testdata/blimp_only_npi_scope-v0-loglikelihood
View file @
8c997e53
fc0be817478c212327050fa297ef61ad214f4847dbff61d4e0fe7914c06a1691
fc0be817478c212327050fa297ef61ad214f4847dbff61d4e0fe7914c06a1691
\ No newline at end of file
tests/
tests/
testdata/blimp_only_npi_scope-v0-res.json
→
tests/testdata/blimp_only_npi_scope-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_only_npi_scope"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_only_npi_scope"
:
0
}}
{
"results"
:
{
"blimp_only_npi_scope"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_only_npi_scope"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_passive_1-v0-loglikelihood
→
tests/testdata/blimp_passive_1-v0-loglikelihood
View file @
8c997e53
fa4addddd8e380031b8e0871776cabcb707c0f21dcaf5d8b3defec66cce55043
fa4addddd8e380031b8e0871776cabcb707c0f21dcaf5d8b3defec66cce55043
\ No newline at end of file
tests/
tests/
testdata/blimp_passive_1-v0-res.json
→
tests/testdata/blimp_passive_1-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_passive_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_passive_1"
:
0
}}
{
"results"
:
{
"blimp_passive_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_passive_1"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_passive_2-v0-loglikelihood
→
tests/testdata/blimp_passive_2-v0-loglikelihood
View file @
8c997e53
755bdfe2c89737c43001ff1dc83d68ad33e444aaf0669af66aaf82dcd09f2eca
755bdfe2c89737c43001ff1dc83d68ad33e444aaf0669af66aaf82dcd09f2eca
\ No newline at end of file
tests/
tests/
testdata/blimp_passive_2-v0-res.json
→
tests/testdata/blimp_passive_2-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_passive_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_passive_2"
:
0
}}
{
"results"
:
{
"blimp_passive_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_passive_2"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_principle_A_c_command-v0-loglikelihood
→
tests/testdata/blimp_principle_A_c_command-v0-loglikelihood
View file @
8c997e53
7c2ed82612af9175052cd44d8e178b6dd084c04eb462a3d88fcacfad2df8be8e
7c2ed82612af9175052cd44d8e178b6dd084c04eb462a3d88fcacfad2df8be8e
\ No newline at end of file
tests/
tests/
testdata/blimp_principle_A_c_command-v0-res.json
→
tests/testdata/blimp_principle_A_c_command-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_principle_A_c_command"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_principle_A_c_command"
:
0
}}
{
"results"
:
{
"blimp_principle_A_c_command"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_principle_A_c_command"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_principle_A_case_1-v0-loglikelihood
→
tests/testdata/blimp_principle_A_case_1-v0-loglikelihood
View file @
8c997e53
49d2b8ce6667a6166fdc2a2e5dbe7ff07d9b8415e9f33482aef15956b3ebc24a
49d2b8ce6667a6166fdc2a2e5dbe7ff07d9b8415e9f33482aef15956b3ebc24a
\ No newline at end of file
tests/
tests/
testdata/blimp_principle_A_case_1-v0-res.json
→
tests/testdata/blimp_principle_A_case_1-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_principle_A_case_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_principle_A_case_1"
:
0
}}
{
"results"
:
{
"blimp_principle_A_case_1"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_principle_A_case_1"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_principle_A_case_2-v0-loglikelihood
→
tests/testdata/blimp_principle_A_case_2-v0-loglikelihood
View file @
8c997e53
cd68adb65c891d672e22bf53c054b2083ab08bc1da43951732b409c942d14bc7
cd68adb65c891d672e22bf53c054b2083ab08bc1da43951732b409c942d14bc7
\ No newline at end of file
tests/
tests/
testdata/blimp_principle_A_case_2-v0-res.json
→
tests/testdata/blimp_principle_A_case_2-v0-res.json
View file @
8c997e53
{
"results"
:
{
"blimp_principle_A_case_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_principle_A_case_2"
:
0
}}
{
"results"
:
{
"blimp_principle_A_case_2"
:
{
"acc"
:
0.485
,
"acc_stderr"
:
0.0158121796418149
}},
"versions"
:
{
"blimp_principle_A_case_2"
:
0
}}
\ No newline at end of file
tests/
tests/
testdata/blimp_principle_A_domain_1-v0-loglikelihood
→
tests/testdata/blimp_principle_A_domain_1-v0-loglikelihood
View file @
8c997e53
290e7eddacea4ec16989af697f2ee3373fdd9aef4b452bf887184c6e2f6e7d9d
290e7eddacea4ec16989af697f2ee3373fdd9aef4b452bf887184c6e2f6e7d9d
\ No newline at end of file
Prev
1
…
3
4
5
6
7
8
9
10
11
…
32
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment