Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
18c0fa29
Commit
18c0fa29
authored
Jun 03, 2023
by
cardy20
Browse files
conflict solved
parents
09915adf
0542d35d
Changes
385
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
18 additions
and
0 deletions
+18
-0
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
.../blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
+0
-0
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
...tdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
+0
-0
tests/testdata/crows_pairs_english-v0-loglikelihood
tests/testdata/crows_pairs_english-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english-v0-res.json
tests/testdata/crows_pairs_english-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_age-v0-loglikelihood
tests/testdata/crows_pairs_english_age-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_age-v0-res.json
tests/testdata/crows_pairs_english_age-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_autre-v0-loglikelihood
tests/testdata/crows_pairs_english_autre-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_autre-v0-res.json
tests/testdata/crows_pairs_english_autre-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_disability-v0-loglikelihood
.../testdata/crows_pairs_english_disability-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_disability-v0-res.json
tests/testdata/crows_pairs_english_disability-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_gender-v0-loglikelihood
tests/testdata/crows_pairs_english_gender-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_gender-v0-res.json
tests/testdata/crows_pairs_english_gender-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_nationality-v0-loglikelihood
...testdata/crows_pairs_english_nationality-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_nationality-v0-res.json
tests/testdata/crows_pairs_english_nationality-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_physical_appearance-v0-loglikelihood
.../crows_pairs_english_physical_appearance-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_physical_appearance-v0-res.json
...tdata/crows_pairs_english_physical_appearance-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_race_color-v0-loglikelihood
.../testdata/crows_pairs_english_race_color-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_race_color-v0-res.json
tests/testdata/crows_pairs_english_race_color-v0-res.json
+1
-0
tests/testdata/crows_pairs_english_religion-v0-loglikelihood
tests/testdata/crows_pairs_english_religion-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_english_religion-v0-res.json
tests/testdata/crows_pairs_english_religion-v0-res.json
+1
-0
No files found.
tests/
tests/
testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
→
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
View file @
18c0fa29
File moved
tests/
tests/
testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
→
tests/testdata/blimp_wh_vs_that_with_gap_long_distance-v0-res.json
View file @
18c0fa29
File moved
tests/testdata/crows_pairs_english-v0-loglikelihood
0 → 100644
View file @
18c0fa29
ee3ce1ddb8071d4189e5b06e7f3c618a434221ac52935d0f434c4d183f01458a
\ No newline at end of file
tests/testdata/crows_pairs_english-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english"
:
{
"likelihood_difference"
:
0.3367363060632734
,
"likelihood_difference_stderr"
:
0.005827747024053628
,
"pct_stereotype"
:
0.5062611806797853
,
"pct_stereotype_stderr"
:
0.012212341600228745
}},
"versions"
:
{
"crows_pairs_english"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_age-v0-loglikelihood
0 → 100644
View file @
18c0fa29
de74d2ac7f926f2f486c045d84aae8f71711102f9d77b31f758fd148810d13d3
\ No newline at end of file
tests/testdata/crows_pairs_english_age-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_age"
:
{
"likelihood_difference"
:
0.3160680928470684
,
"likelihood_difference_stderr"
:
0.02397758321605678
,
"pct_stereotype"
:
0.43956043956043955
,
"pct_stereotype_stderr"
:
0.05231815698566189
}},
"versions"
:
{
"crows_pairs_english_age"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_autre-v0-loglikelihood
0 → 100644
View file @
18c0fa29
a197ccc8538231404a8e43f5ed0fbbfb2c317b4da337f6e7aa9642131aeb426a
\ No newline at end of file
tests/testdata/crows_pairs_english_autre-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_autre"
:
{
"likelihood_difference"
:
0.3424336593343321
,
"likelihood_difference_stderr"
:
0.08588068996335849
,
"pct_stereotype"
:
0.2727272727272727
,
"pct_stereotype_stderr"
:
0.14083575804390605
}},
"versions"
:
{
"crows_pairs_english_autre"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_disability-v0-loglikelihood
0 → 100644
View file @
18c0fa29
90c1bcfdeec0ff51d891ee8cf00ae2a5ec61bab6739faea9865809b8ffed2cdb
\ No newline at end of file
tests/testdata/crows_pairs_english_disability-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_disability"
:
{
"likelihood_difference"
:
0.3148684792547637
,
"likelihood_difference_stderr"
:
0.02800803147051987
,
"pct_stereotype"
:
0.36923076923076925
,
"pct_stereotype_stderr"
:
0.06032456592830047
}},
"versions"
:
{
"crows_pairs_english_disability"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_gender-v0-loglikelihood
0 → 100644
View file @
18c0fa29
2bf62b7cc678f64ffad4a6e6715ff76a2b984bfe8d1165da4b76b3b4dfafb2f9
\ No newline at end of file
tests/testdata/crows_pairs_english_gender-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_gender"
:
{
"likelihood_difference"
:
0.3361377482385407
,
"likelihood_difference_stderr"
:
0.012853081126751691
,
"pct_stereotype"
:
0.478125
,
"pct_stereotype_stderr"
:
0.027967820983765136
}},
"versions"
:
{
"crows_pairs_english_gender"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_nationality-v0-loglikelihood
0 → 100644
View file @
18c0fa29
b85bc849811ccfa9971a6ee3fca7342752c314c0cb6f126e10d9ec4d0450c541
\ No newline at end of file
tests/testdata/crows_pairs_english_nationality-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_nationality"
:
{
"likelihood_difference"
:
0.3383027778174895
,
"likelihood_difference_stderr"
:
0.015957585374543233
,
"pct_stereotype"
:
0.4675925925925926
,
"pct_stereotype_stderr"
:
0.03402801581358966
}},
"versions"
:
{
"crows_pairs_english_nationality"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_physical_appearance-v0-loglikelihood
0 → 100644
View file @
18c0fa29
d1823f5038afafa7a5338e42531720480c8ccf4e177789526caf294d52d56e89
\ No newline at end of file
tests/testdata/crows_pairs_english_physical_appearance-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_physical_appearance"
:
{
"likelihood_difference"
:
0.3221673223187262
,
"likelihood_difference_stderr"
:
0.026978346460100555
,
"pct_stereotype"
:
0.4027777777777778
,
"pct_stereotype_stderr"
:
0.05820650942569533
}},
"versions"
:
{
"crows_pairs_english_physical_appearance"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_race_color-v0-loglikelihood
0 → 100644
View file @
18c0fa29
0a750596d77cd96502dc414ff699a399b1b91c2078adeec1d3dd982b3d591089
\ No newline at end of file
tests/testdata/crows_pairs_english_race_color-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_race_color"
:
{
"likelihood_difference"
:
0.3322827903840805
,
"likelihood_difference_stderr"
:
0.01019838186372816
,
"pct_stereotype"
:
0.4822834645669291
,
"pct_stereotype_stderr"
:
0.022191835500120254
}},
"versions"
:
{
"crows_pairs_english_race_color"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_english_religion-v0-loglikelihood
0 → 100644
View file @
18c0fa29
2ed57377174adaf0fb30037eb055eafdd02cd46e57bc32066d5fecd90a14b6e1
\ No newline at end of file
tests/testdata/crows_pairs_english_religion-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_english_religion"
:
{
"likelihood_difference"
:
0.32170622542430666
,
"likelihood_difference_stderr"
:
0.022101541392310232
,
"pct_stereotype"
:
0.43243243243243246
,
"pct_stereotype_stderr"
:
0.04723583229758394
}},
"versions"
:
{
"crows_pairs_english_religion"
:
0
}}
\ No newline at end of file
Prev
1
…
12
13
14
15
16
17
18
19
20
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment