Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
33315a1f
Commit
33315a1f
authored
Dec 31, 2021
by
Leo Gao
Browse files
pile/wikitext: add testdata
parent
6653cc50
Changes
46
Hide whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
6 additions
and
0 deletions
+6
-0
tests/testdata/pile_wikipedia-v1-loglikelihood_rolling
tests/testdata/pile_wikipedia-v1-loglikelihood_rolling
+1
-0
tests/testdata/pile_wikipedia-v1-res.json
tests/testdata/pile_wikipedia-v1-res.json
+1
-0
tests/testdata/pile_youtubesubtitles-v1-loglikelihood_rolling
...s/testdata/pile_youtubesubtitles-v1-loglikelihood_rolling
+1
-0
tests/testdata/pile_youtubesubtitles-v1-res.json
tests/testdata/pile_youtubesubtitles-v1-res.json
+1
-0
tests/testdata/wikitext-v1-loglikelihood_rolling
tests/testdata/wikitext-v1-loglikelihood_rolling
+1
-0
tests/testdata/wikitext-v1-res.json
tests/testdata/wikitext-v1-res.json
+1
-0
No files found.
tests/testdata/pile_wikipedia-v1-loglikelihood_rolling
0 → 100644
View file @
33315a1f
ef9ec0dd408316ca6537228a6812e839f14b30608973081d41efc47c138338da
\ No newline at end of file
tests/testdata/pile_wikipedia-v1-res.json
0 → 100644
View file @
33315a1f
{
"results"
:
{
"pile_wikipedia"
:
{
"bits_per_byte"
:
0.00024287370359008176
,
"byte_perplexity"
:
1.0001683613940646
,
"word_perplexity"
:
1.001084677949439
}},
"versions"
:
{
"pile_wikipedia"
:
1
}}
\ No newline at end of file
tests/testdata/pile_youtubesubtitles-v1-loglikelihood_rolling
0 → 100644
View file @
33315a1f
68263c52adc0086011e2220b619983935cabb1cc1f5f9f8ee1a74ab2a7457967
\ No newline at end of file
tests/testdata/pile_youtubesubtitles-v1-res.json
0 → 100644
View file @
33315a1f
{
"results"
:
{
"pile_youtubesubtitles"
:
{
"bits_per_byte"
:
3.3827117222045906e-05
,
"byte_perplexity"
:
1.000023447445816
,
"word_perplexity"
:
1.0001529192262875
}},
"versions"
:
{
"pile_youtubesubtitles"
:
1
}}
\ No newline at end of file
tests/testdata/wikitext-v1-loglikelihood_rolling
0 → 100644
View file @
33315a1f
b6f83e6cf7535ee41b0057c3e2ec2cf7f2fa5a9119b305c479a83091d1142b2c
\ No newline at end of file
tests/testdata/wikitext-v1-res.json
0 → 100644
View file @
33315a1f
{
"results"
:
{
"wikitext"
:
{
"bits_per_byte"
:
3.202519859941674e-05
,
"byte_perplexity"
:
1.0000221984224973
,
"word_perplexity"
:
1.000118710696617
}},
"versions"
:
{
"wikitext"
:
1
}}
\ No newline at end of file
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment