Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
18c0fa29
Commit
18c0fa29
authored
Jun 03, 2023
by
cardy20
Browse files
conflict solved
parents
09915adf
0542d35d
Changes
385
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
0 deletions
+20
-0
tests/testdata/crows_pairs_french_religion-v0-loglikelihood
tests/testdata/crows_pairs_french_religion-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_religion-v0-res.json
tests/testdata/crows_pairs_french_religion-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_sexual_orientation-v0-loglikelihood
...ta/crows_pairs_french_sexual_orientation-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_sexual_orientation-v0-res.json
...estdata/crows_pairs_french_sexual_orientation-v0-res.json
+1
-0
tests/testdata/crows_pairs_french_socioeconomic-v0-loglikelihood
...estdata/crows_pairs_french_socioeconomic-v0-loglikelihood
+1
-0
tests/testdata/crows_pairs_french_socioeconomic-v0-res.json
tests/testdata/crows_pairs_french_socioeconomic-v0-res.json
+1
-0
tests/testdata/lambada_openai-v0-loglikelihood
tests/testdata/lambada_openai-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai-v0-res.json
tests/testdata/lambada_openai-v0-res.json
+1
-0
tests/testdata/lambada_openai_cloze-v0-loglikelihood
tests/testdata/lambada_openai_cloze-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_cloze-v0-res.json
tests/testdata/lambada_openai_cloze-v0-res.json
+1
-0
tests/testdata/lambada_openai_mt_de-v0-loglikelihood
tests/testdata/lambada_openai_mt_de-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_mt_de-v0-res.json
tests/testdata/lambada_openai_mt_de-v0-res.json
+1
-0
tests/testdata/lambada_openai_mt_en-v0-loglikelihood
tests/testdata/lambada_openai_mt_en-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_mt_en-v0-res.json
tests/testdata/lambada_openai_mt_en-v0-res.json
+1
-0
tests/testdata/lambada_openai_mt_es-v0-loglikelihood
tests/testdata/lambada_openai_mt_es-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_mt_es-v0-res.json
tests/testdata/lambada_openai_mt_es-v0-res.json
+1
-0
tests/testdata/lambada_openai_mt_fr-v0-loglikelihood
tests/testdata/lambada_openai_mt_fr-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_mt_fr-v0-res.json
tests/testdata/lambada_openai_mt_fr-v0-res.json
+1
-0
tests/testdata/lambada_openai_mt_it-v0-loglikelihood
tests/testdata/lambada_openai_mt_it-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_mt_it-v0-res.json
tests/testdata/lambada_openai_mt_it-v0-res.json
+1
-0
No files found.
tests/testdata/crows_pairs_french_religion-v0-loglikelihood
0 → 100644
View file @
18c0fa29
8af6445eeb634dad5f0723e40615afe993e1e3f129a4f314fe4117e633c2efd3
\ No newline at end of file
tests/testdata/crows_pairs_french_religion-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_french_religion"
:
{
"likelihood_difference"
:
0.32691651640972225
,
"likelihood_difference_stderr"
:
0.021833493193249474
,
"pct_stereotype"
:
0.45217391304347826
,
"pct_stereotype_stderr"
:
0.046614569799583463
}},
"versions"
:
{
"crows_pairs_french_religion"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_sexual_orientation-v0-loglikelihood
0 → 100644
View file @
18c0fa29
2ce823fdb93d325aa8fb40db5d335b093b4b69792763532d940a752440ee3a76
\ No newline at end of file
tests/testdata/crows_pairs_french_sexual_orientation-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_french_sexual_orientation"
:
{
"likelihood_difference"
:
0.3160680928470684
,
"likelihood_difference_stderr"
:
0.02397758321605678
,
"pct_stereotype"
:
0.43956043956043955
,
"pct_stereotype_stderr"
:
0.05231815698566189
}},
"versions"
:
{
"crows_pairs_french_sexual_orientation"
:
0
}}
\ No newline at end of file
tests/testdata/crows_pairs_french_socioeconomic-v0-loglikelihood
0 → 100644
View file @
18c0fa29
8ba0a525c65f795c99f6416e70c998e75e4b6cc43bf9a4bd7ccacd3c3591e9cb
\ No newline at end of file
tests/testdata/crows_pairs_french_socioeconomic-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"crows_pairs_french_socioeconomic"
:
{
"likelihood_difference"
:
0.3394681494647815
,
"likelihood_difference_stderr"
:
0.01702488895584347
,
"pct_stereotype"
:
0.4642857142857143
,
"pct_stereotype_stderr"
:
0.035714285714285705
}},
"versions"
:
{
"crows_pairs_french_socioeconomic"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai-v0-loglikelihood
0 → 100644
View file @
18c0fa29
6829e6a8aa5922e6c92dd31403cc060f242dc0ede4a775e085a70da095ab2e20
\ No newline at end of file
tests/testdata/lambada_openai-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"lambada_openai"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_cloze-v0-loglikelihood
0 → 100644
View file @
18c0fa29
7655e748b63ae7e9911411d2d2a2577221d6c861ca4448509992541294d689f3
\ No newline at end of file
tests/testdata/lambada_openai_cloze-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"lambada_openai_cloze"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_cloze"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_mt_de-v0-loglikelihood
0 → 100644
View file @
18c0fa29
5ad125e1708499832b2cee8c3388f89f9c0277010fd96fbd3359039ce8105984
\ No newline at end of file
tests/testdata/lambada_openai_mt_de-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"lambada_openai_mt_de"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_mt_de"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_mt_en-v0-loglikelihood
0 → 100644
View file @
18c0fa29
6829e6a8aa5922e6c92dd31403cc060f242dc0ede4a775e085a70da095ab2e20
\ No newline at end of file
tests/testdata/lambada_openai_mt_en-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"lambada_openai_mt_en"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_mt_en"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_mt_es-v0-loglikelihood
0 → 100644
View file @
18c0fa29
4a88f4b316c72fe0396c382d6cbb33568ac4d0ad225150d3536635c085359fc9
\ No newline at end of file
tests/testdata/lambada_openai_mt_es-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"lambada_openai_mt_es"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_mt_es"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_mt_fr-v0-loglikelihood
0 → 100644
View file @
18c0fa29
5d16f4a0c51dc6d7b6df2ebeba2bbfa51e700b843779b559b3d90183d7b02a11
\ No newline at end of file
tests/testdata/lambada_openai_mt_fr-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"lambada_openai_mt_fr"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_mt_fr"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_openai_mt_it-v0-loglikelihood
0 → 100644
View file @
18c0fa29
fd87c6c5cf4e0499c5f9f80e5bd7ee6a4f3d2991902a0cc3ec9e6eaf22d6760a
\ No newline at end of file
tests/testdata/lambada_openai_mt_it-v0-res.json
0 → 100644
View file @
18c0fa29
{
"results"
:
{
"lambada_openai_mt_it"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_mt_it"
:
0
}}
\ No newline at end of file
Prev
1
…
14
15
16
17
18
19
20
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment