Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
baa8b0d3
Commit
baa8b0d3
authored
May 18, 2023
by
bzantium
Browse files
fix for merge from master
parent
a956bc63
Changes
392
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
0 deletions
+20
-0
tests/testdata/crows_pairs_french_gender-v0-res.json
tests/testdata/crows_pairs_french_gender-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_nationality-v0-loglikelihood
.../testdata/crows_pairs_french_nationality-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_nationality-v0-res.json
tests/testdata/crows_pairs_french_nationality-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_physical_appearance-v0-loglikelihood
...a/crows_pairs_french_physical_appearance-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_physical_appearance-v0-res.json
...stdata/crows_pairs_french_physical_appearance-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_race_color-v0-loglikelihood
...s/testdata/crows_pairs_french_race_color-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_race_color-v0-res.json
tests/testdata/crows_pairs_french_race_color-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_religion-v0-loglikelihood
tests/testdata/crows_pairs_french_religion-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_religion-v0-res.json
tests/testdata/crows_pairs_french_religion-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_sexual_orientation-v0-loglikelihood
...ta/crows_pairs_french_sexual_orientation-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_sexual_orientation-v0-res.json
...estdata/crows_pairs_french_sexual_orientation-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_socioeconomic-v0-loglikelihood
...estdata/crows_pairs_french_socioeconomic-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_socioeconomic-v0-res.json
tests/testdata/crows_pairs_french_socioeconomic-v0-res.json
+1
-0
tests/testdata/lambada_openai-v0-loglikelihood
tests/testdata/lambada_openai-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai-v0-res.json
tests/testdata/lambada_openai-v0-res.json
+1
-0
tests/testdata/lambada_openai_cloze-v0-loglikelihood
tests/testdata/lambada_openai_cloze-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_cloze-v0-res.json
tests/testdata/lambada_openai_cloze-v0-res.json
+1
-0
tests/testdata/lambada_openai_mt_de-v0-loglikelihood
tests/testdata/lambada_openai_mt_de-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_mt_de-v0-res.json
tests/testdata/lambada_openai_mt_de-v0-res.json
+1
-0
tests/testdata/lambada_openai_mt_en-v0-loglikelihood
tests/testdata/lambada_openai_mt_en-v0-loglikelihood
+1
-0
No files found.
tests/testdata/crows_pairs_french_gender-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_french_gender"
:
{
"likelihood_difference"
:
0.3364019171359413
,
"likelihood_difference_stderr"
:
0.012815700745990895
,
"pct_stereotype"
:
0.4766355140186916
,
"pct_stereotype_stderr"
:
0.027920316348204986
}},
"versions"
:
{
"crows_pairs_french_gender"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_nationality-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
146eb60c8796fe3f25307a6776337f0b077b58ce02edec64c99df4b906c19b9f
\ No newline at end of file
tests/testdata/crows_pairs_french_nationality-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_french_nationality"
:
{
"likelihood_difference"
:
0.33534193269044926
,
"likelihood_difference_stderr"
:
0.01429836309463257
,
"pct_stereotype"
:
0.4743083003952569
,
"pct_stereotype_stderr"
:
0.031455431847992904
}},
"versions"
:
{
"crows_pairs_french_nationality"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_physical_appearance-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
ea61eaad64e9292790d4bbef955ffeebed7a595de098bc5ac726a6e51f27f9af
\ No newline at end of file
tests/testdata/crows_pairs_french_physical_appearance-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_french_physical_appearance"
:
{
"likelihood_difference"
:
0.3221673223187262
,
"likelihood_difference_stderr"
:
0.026978346460100555
,
"pct_stereotype"
:
0.4027777777777778
,
"pct_stereotype_stderr"
:
0.05820650942569533
}},
"versions"
:
{
"crows_pairs_french_physical_appearance"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_race_color-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
6f9119026abff33c5c882d6172e092e806a8b21bd86864022978b1961839350f
\ No newline at end of file
tests/testdata/crows_pairs_french_race_color-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_french_race_color"
:
{
"likelihood_difference"
:
0.33233909422443764
,
"likelihood_difference_stderr"
:
0.010623405969915857
,
"pct_stereotype"
:
0.4782608695652174
,
"pct_stereotype_stderr"
:
0.023315932363473738
}},
"versions"
:
{
"crows_pairs_french_race_color"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_religion-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
8af6445eeb634dad5f0723e40615afe993e1e3f129a4f314fe4117e633c2efd3
\ No newline at end of file
tests/testdata/crows_pairs_french_religion-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_french_religion"
:
{
"likelihood_difference"
:
0.32691651640972225
,
"likelihood_difference_stderr"
:
0.021833493193249474
,
"pct_stereotype"
:
0.45217391304347826
,
"pct_stereotype_stderr"
:
0.046614569799583463
}},
"versions"
:
{
"crows_pairs_french_religion"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_sexual_orientation-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
2ce823fdb93d325aa8fb40db5d335b093b4b69792763532d940a752440ee3a76
\ No newline at end of file
tests/testdata/crows_pairs_french_sexual_orientation-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_french_sexual_orientation"
:
{
"likelihood_difference"
:
0.3160680928470684
,
"likelihood_difference_stderr"
:
0.02397758321605678
,
"pct_stereotype"
:
0.43956043956043955
,
"pct_stereotype_stderr"
:
0.05231815698566189
}},
"versions"
:
{
"crows_pairs_french_sexual_orientation"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_socioeconomic-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
8ba0a525c65f795c99f6416e70c998e75e4b6cc43bf9a4bd7ccacd3c3591e9cb
\ No newline at end of file
tests/testdata/crows_pairs_french_socioeconomic-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"crows_pairs_french_socioeconomic"
:
{
"likelihood_difference"
:
0.3394681494647815
,
"likelihood_difference_stderr"
:
0.01702488895584347
,
"pct_stereotype"
:
0.4642857142857143
,
"pct_stereotype_stderr"
:
0.035714285714285705
}},
"versions"
:
{
"crows_pairs_french_socioeconomic"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
6829e6a8aa5922e6c92dd31403cc060f242dc0ede4a775e085a70da095ab2e20
\ No newline at end of file
tests/testdata/lambada_openai-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"lambada_openai"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_cloze-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
7655e748b63ae7e9911411d2d2a2577221d6c861ca4448509992541294d689f3
\ No newline at end of file
tests/testdata/lambada_openai_cloze-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"lambada_openai_cloze"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_cloze"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_mt_de-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
5ad125e1708499832b2cee8c3388f89f9c0277010fd96fbd3359039ce8105984
\ No newline at end of file
tests/testdata/lambada_openai_mt_de-v0-res.json
0 → 100644
View file @
baa8b0d3
{
"results"
:
{
"lambada_openai_mt_de"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_mt_de"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_mt_en-v0-loglikelihood
0 → 100644
View file @
baa8b0d3
6829e6a8aa5922e6c92dd31403cc060f242dc0ede4a775e085a70da095ab2e20
\ No newline at end of file
Prev
1
…
14
15
16
17
18
19
20
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment