Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
121b7096
Commit
121b7096
authored
May 02, 2022
by
Fabrizio Milo
Browse files
add pre-commit
parent
7a038118
Changes
732
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/pile_hackernews-v0-loglikelihood_rolling
tests/testdata/pile_hackernews-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_hackernews-v0-res.json
tests/testdata/pile_hackernews-v0-res.json
+1
-1
tests/testdata/pile_hackernews-v1-loglikelihood_rolling
tests/testdata/pile_hackernews-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_hackernews-v1-res.json
tests/testdata/pile_hackernews-v1-res.json
+1
-1
tests/testdata/pile_nih-exporter-v0-loglikelihood_rolling
tests/testdata/pile_nih-exporter-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_nih-exporter-v0-res.json
tests/testdata/pile_nih-exporter-v0-res.json
+1
-1
tests/testdata/pile_nih-exporter-v1-loglikelihood_rolling
tests/testdata/pile_nih-exporter-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_nih-exporter-v1-res.json
tests/testdata/pile_nih-exporter-v1-res.json
+1
-1
tests/testdata/pile_opensubtitles-v0-loglikelihood_rolling
tests/testdata/pile_opensubtitles-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_opensubtitles-v0-res.json
tests/testdata/pile_opensubtitles-v0-res.json
+1
-1
tests/testdata/pile_opensubtitles-v1-loglikelihood_rolling
tests/testdata/pile_opensubtitles-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_opensubtitles-v1-res.json
tests/testdata/pile_opensubtitles-v1-res.json
+1
-1
tests/testdata/pile_openwebtext2-v0-loglikelihood_rolling
tests/testdata/pile_openwebtext2-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_openwebtext2-v0-res.json
tests/testdata/pile_openwebtext2-v0-res.json
+1
-1
tests/testdata/pile_openwebtext2-v1-loglikelihood_rolling
tests/testdata/pile_openwebtext2-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_openwebtext2-v1-res.json
tests/testdata/pile_openwebtext2-v1-res.json
+1
-1
tests/testdata/pile_philpapers-v0-loglikelihood_rolling
tests/testdata/pile_philpapers-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_philpapers-v0-res.json
tests/testdata/pile_philpapers-v0-res.json
+1
-1
tests/testdata/pile_philpapers-v1-loglikelihood_rolling
tests/testdata/pile_philpapers-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_philpapers-v1-res.json
tests/testdata/pile_philpapers-v1-res.json
+1
-1
No files found.
tests/testdata/pile_hackernews-v0-loglikelihood_rolling
View file @
121b7096
ec1082ee5a5326e0d57aa4e73b634937140c1de9af95f154e8ab57b05d9b422b
ec1082ee5a5326e0d57aa4e73b634937140c1de9af95f154e8ab57b05d9b422b
\ No newline at end of file
tests/testdata/pile_hackernews-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_hackernews"
:
{
"bits_per_byte"
:
0.00010170276359193358
,
"byte_perplexity"
:
1.0001017079354932
,
"word_perplexity"
:
1.0006273924348839
}},
"versions"
:
{
"pile_hackernews"
:
0
}}
{
"results"
:
{
"pile_hackernews"
:
{
"bits_per_byte"
:
0.00010170276359193358
,
"byte_perplexity"
:
1.0001017079354932
,
"word_perplexity"
:
1.0006273924348839
}},
"versions"
:
{
"pile_hackernews"
:
0
}}
\ No newline at end of file
tests/testdata/pile_hackernews-v1-loglikelihood_rolling
View file @
121b7096
ec1082ee5a5326e0d57aa4e73b634937140c1de9af95f154e8ab57b05d9b422b
ec1082ee5a5326e0d57aa4e73b634937140c1de9af95f154e8ab57b05d9b422b
\ No newline at end of file
tests/testdata/pile_hackernews-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_hackernews"
:
{
"bits_per_byte"
:
0.00014672607267878518
,
"byte_perplexity"
:
1.0001017079354932
,
"word_perplexity"
:
1.0006273924348839
}},
"versions"
:
{
"pile_hackernews"
:
1
}}
{
"results"
:
{
"pile_hackernews"
:
{
"bits_per_byte"
:
0.00014672607267878518
,
"byte_perplexity"
:
1.0001017079354932
,
"word_perplexity"
:
1.0006273924348839
}},
"versions"
:
{
"pile_hackernews"
:
1
}}
\ No newline at end of file
tests/testdata/pile_nih-exporter-v0-loglikelihood_rolling
View file @
121b7096
520ea6e04e8a39dc0b5f63a837429a78a40e63d39d109096101feb8c5b2cf8d8
520ea6e04e8a39dc0b5f63a837429a78a40e63d39d109096101feb8c5b2cf8d8
\ No newline at end of file
tests/testdata/pile_nih-exporter-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_nih-exporter"
:
{
"bits_per_byte"
:
0.00024394433346975716
,
"byte_perplexity"
:
1.0002439740903082
,
"word_perplexity"
:
1.0016712202288802
}},
"versions"
:
{
"pile_nih-exporter"
:
0
}}
{
"results"
:
{
"pile_nih-exporter"
:
{
"bits_per_byte"
:
0.00024394433346975716
,
"byte_perplexity"
:
1.0002439740903082
,
"word_perplexity"
:
1.0016712202288802
}},
"versions"
:
{
"pile_nih-exporter"
:
0
}}
\ No newline at end of file
tests/testdata/pile_nih-exporter-v1-loglikelihood_rolling
View file @
121b7096
520ea6e04e8a39dc0b5f63a837429a78a40e63d39d109096101feb8c5b2cf8d8
520ea6e04e8a39dc0b5f63a837429a78a40e63d39d109096101feb8c5b2cf8d8
\ No newline at end of file
tests/testdata/pile_nih-exporter-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_nih-exporter"
:
{
"bits_per_byte"
:
0.00035193728014978225
,
"byte_perplexity"
:
1.0002439740903082
,
"word_perplexity"
:
1.0016712202288802
}},
"versions"
:
{
"pile_nih-exporter"
:
1
}}
{
"results"
:
{
"pile_nih-exporter"
:
{
"bits_per_byte"
:
0.00035193728014978225
,
"byte_perplexity"
:
1.0002439740903082
,
"word_perplexity"
:
1.0016712202288802
}},
"versions"
:
{
"pile_nih-exporter"
:
1
}}
\ No newline at end of file
tests/testdata/pile_opensubtitles-v0-loglikelihood_rolling
View file @
121b7096
0f1c23a1f4ddec0c2b1ff34de8d1505b0eb9e2868d8edbcc1b6de13d02f32036
0f1c23a1f4ddec0c2b1ff34de8d1505b0eb9e2868d8edbcc1b6de13d02f32036
\ No newline at end of file
tests/testdata/pile_opensubtitles-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_opensubtitles"
:
{
"bits_per_byte"
:
1.5213441136639177e-05
,
"byte_perplexity"
:
1.0000152135568616
,
"word_perplexity"
:
1.0000856162053249
}},
"versions"
:
{
"pile_opensubtitles"
:
0
}}
{
"results"
:
{
"pile_opensubtitles"
:
{
"bits_per_byte"
:
1.5213441136639177e-05
,
"byte_perplexity"
:
1.0000152135568616
,
"word_perplexity"
:
1.0000856162053249
}},
"versions"
:
{
"pile_opensubtitles"
:
0
}}
\ No newline at end of file
tests/testdata/pile_opensubtitles-v1-loglikelihood_rolling
View file @
121b7096
0f1c23a1f4ddec0c2b1ff34de8d1505b0eb9e2868d8edbcc1b6de13d02f32036
0f1c23a1f4ddec0c2b1ff34de8d1505b0eb9e2868d8edbcc1b6de13d02f32036
\ No newline at end of file
tests/testdata/pile_opensubtitles-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_opensubtitles"
:
{
"bits_per_byte"
:
2.1948356082685497e-05
,
"byte_perplexity"
:
1.0000152135568616
,
"word_perplexity"
:
1.0000856162053249
}},
"versions"
:
{
"pile_opensubtitles"
:
1
}}
{
"results"
:
{
"pile_opensubtitles"
:
{
"bits_per_byte"
:
2.1948356082685497e-05
,
"byte_perplexity"
:
1.0000152135568616
,
"word_perplexity"
:
1.0000856162053249
}},
"versions"
:
{
"pile_opensubtitles"
:
1
}}
\ No newline at end of file
tests/testdata/pile_openwebtext2-v0-loglikelihood_rolling
View file @
121b7096
5d6c19665f429ab1ccbe027da67f42bdaf219f819ab093673976eee55e015ff4
5d6c19665f429ab1ccbe027da67f42bdaf219f819ab093673976eee55e015ff4
\ No newline at end of file
tests/testdata/pile_openwebtext2-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_openwebtext2"
:
{
"bits_per_byte"
:
0.00012809520662477846
,
"byte_perplexity"
:
1.000128103411166
,
"word_perplexity"
:
1.0007951516532847
}},
"versions"
:
{
"pile_openwebtext2"
:
0
}}
{
"results"
:
{
"pile_openwebtext2"
:
{
"bits_per_byte"
:
0.00012809520662477846
,
"byte_perplexity"
:
1.000128103411166
,
"word_perplexity"
:
1.0007951516532847
}},
"versions"
:
{
"pile_openwebtext2"
:
0
}}
\ No newline at end of file
tests/testdata/pile_openwebtext2-v1-loglikelihood_rolling
View file @
121b7096
5d6c19665f429ab1ccbe027da67f42bdaf219f819ab093673976eee55e015ff4
5d6c19665f429ab1ccbe027da67f42bdaf219f819ab093673976eee55e015ff4
\ No newline at end of file
tests/testdata/pile_openwebtext2-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_openwebtext2"
:
{
"bits_per_byte"
:
0.000184802319359215
,
"byte_perplexity"
:
1.000128103411166
,
"word_perplexity"
:
1.0007951516532847
}},
"versions"
:
{
"pile_openwebtext2"
:
1
}}
{
"results"
:
{
"pile_openwebtext2"
:
{
"bits_per_byte"
:
0.000184802319359215
,
"byte_perplexity"
:
1.000128103411166
,
"word_perplexity"
:
1.0007951516532847
}},
"versions"
:
{
"pile_openwebtext2"
:
1
}}
\ No newline at end of file
tests/testdata/pile_philpapers-v0-loglikelihood_rolling
View file @
121b7096
339ba5d8c044c4a3ff9b9a8eaa24da1d6c01b72972074eb671a7da049eeb7047
339ba5d8c044c4a3ff9b9a8eaa24da1d6c01b72972074eb671a7da049eeb7047
\ No newline at end of file
tests/testdata/pile_philpapers-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_philpapers"
:
{
"bits_per_byte"
:
6.241575895982095e-06
,
"byte_perplexity"
:
1.0000062415953748
,
"word_perplexity"
:
1.0000409888564146
}},
"versions"
:
{
"pile_philpapers"
:
0
}}
{
"results"
:
{
"pile_philpapers"
:
{
"bits_per_byte"
:
6.241575895982095e-06
,
"byte_perplexity"
:
1.0000062415953748
,
"word_perplexity"
:
1.0000409888564146
}},
"versions"
:
{
"pile_philpapers"
:
0
}}
\ No newline at end of file
tests/testdata/pile_philpapers-v1-loglikelihood_rolling
View file @
121b7096
339ba5d8c044c4a3ff9b9a8eaa24da1d6c01b72972074eb671a7da049eeb7047
339ba5d8c044c4a3ff9b9a8eaa24da1d6c01b72972074eb671a7da049eeb7047
\ No newline at end of file
tests/testdata/pile_philpapers-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_philpapers"
:
{
"bits_per_byte"
:
9.004690592465457e-06
,
"byte_perplexity"
:
1.0000062415953748
,
"word_perplexity"
:
1.0000409888564146
}},
"versions"
:
{
"pile_philpapers"
:
1
}}
{
"results"
:
{
"pile_philpapers"
:
{
"bits_per_byte"
:
9.004690592465457e-06
,
"byte_perplexity"
:
1.0000062415953748
,
"word_perplexity"
:
1.0000409888564146
}},
"versions"
:
{
"pile_philpapers"
:
1
}}
\ No newline at end of file
Prev
1
…
18
19
20
21
22
23
24
25
26
…
37
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment