Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
bfa57687
Commit
bfa57687
authored
Nov 24, 2022
by
jon-tow
Browse files
Add the original `LAMBADA` dataset
parent
4f0410a4
Changes
26
Hide whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
6 additions
and
0 deletions
+6
-0
tests/testdata/lambada_openai_mt_it-v0-loglikelihood
tests/testdata/lambada_openai_mt_it-v0-loglikelihood
+1
-0
tests/testdata/lambada_openai_mt_it-v0-res.json
tests/testdata/lambada_openai_mt_it-v0-res.json
+1
-0
tests/testdata/lambada_standard-v0-loglikelihood
tests/testdata/lambada_standard-v0-loglikelihood
+1
-0
tests/testdata/lambada_standard-v0-res.json
tests/testdata/lambada_standard-v0-res.json
+1
-0
tests/testdata/lambada_standard_cloze-v0-loglikelihood
tests/testdata/lambada_standard_cloze-v0-loglikelihood
+1
-0
tests/testdata/lambada_standard_cloze-v0-res.json
tests/testdata/lambada_standard_cloze-v0-res.json
+1
-0
No files found.
tests/testdata/lambada_openai_mt_it-v0-loglikelihood
0 → 100644
View file @
bfa57687
fd87c6c5cf4e0499c5f9f80e5bd7ee6a4f3d2991902a0cc3ec9e6eaf22d6760a
\ No newline at end of file
tests/testdata/lambada_openai_mt_it-v0-res.json
0 → 100644
View file @
bfa57687
{
"results"
:
{
"lambada_openai_mt_it"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_openai_mt_it"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_standard-v0-loglikelihood
0 → 100644
View file @
bfa57687
8958d9f8d8145046b692fadd8a9cc9c8bad5617c10774280cf7c24c21d2be160
\ No newline at end of file
tests/testdata/lambada_standard-v0-res.json
0 → 100644
View file @
bfa57687
{
"results"
:
{
"lambada_standard"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_standard"
:
0
}}
\ No newline at end of file
tests/testdata/lambada_standard_cloze-v0-loglikelihood
0 → 100644
View file @
bfa57687
b604f00bc9f2a77ef41f8cfdb5a8509b3ae9266893b9e90abc665f5399ecba4e
\ No newline at end of file
tests/testdata/lambada_standard_cloze-v0-res.json
0 → 100644
View file @
bfa57687
{
"results"
:
{
"lambada_standard_cloze"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
,
"ppl"
:
1.6479047769869253
,
"ppl_stderr"
:
0.006497321146240192
}},
"versions"
:
{
"lambada_standard_cloze"
:
0
}}
\ No newline at end of file
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment