Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
baa8b0d3
Commit
baa8b0d3
authored
May 18, 2023
by
bzantium
Browse files
fix for merge from master
parent
a956bc63
Changes
392
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
11 additions
and
0 deletions
+11
-0
tests/testdata/blimp_wh_questions_subject_gap_long_distance-v0-res.json
.../blimp_wh_questions_subject_gap_long_distance-v0-res.json
+0
-0
tests/testdata/blimp_wh_vs_that_no_gap-v0-loglikelihood
tests/testdata/blimp_wh_vs_that_no_gap-v0-loglikelihood
+0
-0
tests/testdata/blimp_wh_vs_that_no_gap-v0-res.json
tests/testdata/blimp_wh_vs_that_no_gap-v0-res.json
+0
-0
tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-loglikelihood
...ta/blimp_wh_vs_that_no_gap_long_distance-v0-loglikelihood
+0
-0
tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-res.json
...estdata/blimp_wh_vs_that_no_gap_long_distance-v0-res.json
+0
-0
tests/testdata/blimp_wh_vs_that_with_gap-v0-loglikelihood
tests/testdata/blimp_wh_vs_that_with_gap-v0-loglikelihood
+0
-0
tests/testdata/blimp_wh_vs_that_with_gap-v0-res.json
tests/testdata/blimp_wh_vs_that_with_gap-v0-res.json
+0
-0
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
.../blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
+0
-0
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
...tdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
+0
-0
tests/testdata/crows_pairs_english-v0-loglikelihood
tests/testdata/crows_pairs_english-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english-v0-res.json
tests/testdata/crows_pairs_english-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_age-v0-loglikelihood
tests/testdata/crows_pairs_english_age-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_age-v0-res.json
tests/testdata/crows_pairs_english_age-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_autre-v0-loglikelihood
tests/testdata/crows_pairs_english_autre-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_autre-v0-res.json
tests/testdata/crows_pairs_english_autre-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_disability-v0-loglikelihood
.../testdata/crows_pairs_english_disability-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_disability-v0-res.json
tests/testdata/crows_pairs_english_disability-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_gender-v0-loglikelihood
tests/testdata/crows_pairs_english_gender-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_gender-v0-res.json
tests/testdata/crows_pairs_english_gender-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_nationality-v0-loglikelihood
...testdata/crows_pairs_english_nationality-v0-loglikelihood
+1
-0
No files found.
tests/
tests/
testdata/blimp_wh_questions_subject_gap_long_distance-v0-res.json
→
tests/testdata/blimp_wh_questions_subject_gap_long_distance-v0-res.json
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_no_gap-v0-loglikelihood
→
tests/testdata/blimp_wh_vs_that_no_gap-v0-loglikelihood
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_no_gap-v0-res.json
→
tests/testdata/blimp_wh_vs_that_no_gap-v0-res.json
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_no_gap_long_distance-v0-loglikelihood
→
tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-loglikelihood
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_no_gap_long_distance-v0-res.json
→
tests/testdata/blimp_wh_vs_that_no_gap_long_distance-v0-res.json
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_with_gap-v0-loglikelihood
→
tests/testdata/blimp_wh_vs_that_with_gap-v0-loglikelihood
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_with_gap-v0-res.json
→
tests/testdata/blimp_wh_vs_that_with_gap-v0-res.json
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
→
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
View file @
baa8b0d3
File moved
tests/
tests/
testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
→
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
View file @
baa8b0d3
File moved
tests/testdata/crows_pairs_english-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
ee3ce1ddb8071d4189e5b06e7f3c618a434221ac52935d0f434c4d183f01458a
\ No newline at end of file
tests/testdata/crows_pairs_english-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_english"
:
{
"likelihood_difference"
:
0.3367363060632734
,
"likelihood_difference_stderr"
:
0.005827747024053628
,
"pct_stereotype"
:
0.5062611806797853
,
"pct_stereotype_stderr"
:
0.012212341600228745
}},
"versions"
:
{
"crows_pairs_english"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_age-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
de74d2ac7f926f2f486c045d84aae8f71711102f9d77b31f758fd148810d13d3
\ No newline at end of file
tests/testdata/crows_pairs_english_age-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_english_age"
:
{
"likelihood_difference"
:
0.3160680928470684
,
"likelihood_difference_stderr"
:
0.02397758321605678
,
"pct_stereotype"
:
0.43956043956043955
,
"pct_stereotype_stderr"
:
0.05231815698566189
}},
"versions"
:
{
"crows_pairs_english_age"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_autre-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
a197ccc8538231404a8e43f5ed0fbbfb2c317b4da337f6e7aa9642131aeb426a
\ No newline at end of file
tests/testdata/crows_pairs_english_autre-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_english_autre"
:
{
"likelihood_difference"
:
0.3424336593343321
,
"likelihood_difference_stderr"
:
0.08588068996335849
,
"pct_stereotype"
:
0.2727272727272727
,
"pct_stereotype_stderr"
:
0.14083575804390605
}},
"versions"
:
{
"crows_pairs_english_autre"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_disability-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
90c1bcfdeec0ff51d891ee8cf00ae2a5ec61bab6739faea9865809b8ffed2cdb
\ No newline at end of file
tests/testdata/crows_pairs_english_disability-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_english_disability"
:
{
"likelihood_difference"
:
0.3148684792547637
,
"likelihood_difference_stderr"
:
0.02800803147051987
,
"pct_stereotype"
:
0.36923076923076925
,
"pct_stereotype_stderr"
:
0.06032456592830047
}},
"versions"
:
{
"crows_pairs_english_disability"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_gender-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
2bf62b7cc678f64ffad4a6e6715ff76a2b984bfe8d1165da4b76b3b4dfafb2f9
\ No newline at end of file
tests/testdata/crows_pairs_english_gender-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_english_gender"
:
{
"likelihood_difference"
:
0.3361377482385407
,
"likelihood_difference_stderr"
:
0.012853081126751691
,
"pct_stereotype"
:
0.478125
,
"pct_stereotype_stderr"
:
0.027967820983765136
}},
"versions"
:
{
"crows_pairs_english_gender"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_nationality-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
b85bc849811ccfa9971a6ee3fca7342752c314c0cb6f126e10d9ec4d0450c541
\ No newline at end of file
Prev
1
…
12
13
14
15
16
17
18
19
20
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment