Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
121b7096
Commit
121b7096
authored
May 02, 2022
by
Fabrizio Milo
Browse files
add pre-commit
parent
7a038118
Changes
732
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/pile_enron-v0-loglikelihood_rolling
tests/testdata/pile_enron-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_enron-v0-res.json
tests/testdata/pile_enron-v0-res.json
+1
-1
tests/testdata/pile_enron-v1-loglikelihood_rolling
tests/testdata/pile_enron-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_enron-v1-res.json
tests/testdata/pile_enron-v1-res.json
+1
-1
tests/testdata/pile_europarl-v0-loglikelihood_rolling
tests/testdata/pile_europarl-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_europarl-v0-res.json
tests/testdata/pile_europarl-v0-res.json
+1
-1
tests/testdata/pile_europarl-v1-loglikelihood_rolling
tests/testdata/pile_europarl-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_europarl-v1-res.json
tests/testdata/pile_europarl-v1-res.json
+1
-1
tests/testdata/pile_freelaw-v0-loglikelihood_rolling
tests/testdata/pile_freelaw-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_freelaw-v0-res.json
tests/testdata/pile_freelaw-v0-res.json
+1
-1
tests/testdata/pile_freelaw-v1-loglikelihood_rolling
tests/testdata/pile_freelaw-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_freelaw-v1-res.json
tests/testdata/pile_freelaw-v1-res.json
+1
-1
tests/testdata/pile_github-v0-loglikelihood_rolling
tests/testdata/pile_github-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_github-v0-res.json
tests/testdata/pile_github-v0-res.json
+1
-1
tests/testdata/pile_github-v1-loglikelihood_rolling
tests/testdata/pile_github-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_github-v1-res.json
tests/testdata/pile_github-v1-res.json
+1
-1
tests/testdata/pile_gutenberg-v0-loglikelihood_rolling
tests/testdata/pile_gutenberg-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_gutenberg-v0-res.json
tests/testdata/pile_gutenberg-v0-res.json
+1
-1
tests/testdata/pile_gutenberg-v1-loglikelihood_rolling
tests/testdata/pile_gutenberg-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_gutenberg-v1-res.json
tests/testdata/pile_gutenberg-v1-res.json
+1
-1
No files found.
tests/testdata/pile_enron-v0-loglikelihood_rolling
View file @
121b7096
4baa6ccdc9e3aa9921675ab4400d5e89d7b546b844a8ea28f6461d649066418a
4baa6ccdc9e3aa9921675ab4400d5e89d7b546b844a8ea28f6461d649066418a
\ No newline at end of file
tests/testdata/pile_enron-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_enron"
:
{
"bits_per_byte"
:
0.0003163902828673244
,
"byte_perplexity"
:
1.000316440339552
,
"word_perplexity"
:
1.00224668051869
}},
"versions"
:
{
"pile_enron"
:
0
}}
{
"results"
:
{
"pile_enron"
:
{
"bits_per_byte"
:
0.0003163902828673244
,
"byte_perplexity"
:
1.000316440339552
,
"word_perplexity"
:
1.00224668051869
}},
"versions"
:
{
"pile_enron"
:
0
}}
\ No newline at end of file
tests/testdata/pile_enron-v1-loglikelihood_rolling
View file @
121b7096
4baa6ccdc9e3aa9921675ab4400d5e89d7b546b844a8ea28f6461d649066418a
4baa6ccdc9e3aa9921675ab4400d5e89d7b546b844a8ea28f6461d649066418a
\ No newline at end of file
tests/testdata/pile_enron-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_enron"
:
{
"bits_per_byte"
:
0.0004564546920781453
,
"byte_perplexity"
:
1.000316440339552
,
"word_perplexity"
:
1.00224668051869
}},
"versions"
:
{
"pile_enron"
:
1
}}
{
"results"
:
{
"pile_enron"
:
{
"bits_per_byte"
:
0.0004564546920781453
,
"byte_perplexity"
:
1.000316440339552
,
"word_perplexity"
:
1.00224668051869
}},
"versions"
:
{
"pile_enron"
:
1
}}
\ No newline at end of file
tests/testdata/pile_europarl-v0-loglikelihood_rolling
View file @
121b7096
e67d3dbccd47d308bfc5b0e66b76d0dfc5e386ebfa94e056562c2281c395543f
e67d3dbccd47d308bfc5b0e66b76d0dfc5e386ebfa94e056562c2281c395543f
\ No newline at end of file
tests/testdata/pile_europarl-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_europarl"
:
{
"bits_per_byte"
:
8.648858203555344e-06
,
"byte_perplexity"
:
1.000008648895605
,
"word_perplexity"
:
1.000063506523818
}},
"versions"
:
{
"pile_europarl"
:
0
}}
{
"results"
:
{
"pile_europarl"
:
{
"bits_per_byte"
:
8.648858203555344e-06
,
"byte_perplexity"
:
1.000008648895605
,
"word_perplexity"
:
1.000063506523818
}},
"versions"
:
{
"pile_europarl"
:
0
}}
\ No newline at end of file
tests/testdata/pile_europarl-v1-loglikelihood_rolling
View file @
121b7096
e67d3dbccd47d308bfc5b0e66b76d0dfc5e386ebfa94e056562c2281c395543f
e67d3dbccd47d308bfc5b0e66b76d0dfc5e386ebfa94e056562c2281c395543f
\ No newline at end of file
tests/testdata/pile_europarl-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_europarl"
:
{
"bits_per_byte"
:
1.2477664839621123e-05
,
"byte_perplexity"
:
1.000008648895605
,
"word_perplexity"
:
1.000063506523818
}},
"versions"
:
{
"pile_europarl"
:
1
}}
{
"results"
:
{
"pile_europarl"
:
{
"bits_per_byte"
:
1.2477664839621123e-05
,
"byte_perplexity"
:
1.000008648895605
,
"word_perplexity"
:
1.000063506523818
}},
"versions"
:
{
"pile_europarl"
:
1
}}
\ No newline at end of file
tests/testdata/pile_freelaw-v0-loglikelihood_rolling
View file @
121b7096
d77f3f68aadd6cbf1290c2f6737b2ed5d5c2a60e4c81a65c280f207783caabe1
d77f3f68aadd6cbf1290c2f6737b2ed5d5c2a60e4c81a65c280f207783caabe1
\ No newline at end of file
tests/testdata/pile_freelaw-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_freelaw"
:
{
"bits_per_byte"
:
3.16238943008513e-05
,
"byte_perplexity"
:
1.0000316243943415
,
"word_perplexity"
:
1.000203169094218
}},
"versions"
:
{
"pile_freelaw"
:
0
}}
{
"results"
:
{
"pile_freelaw"
:
{
"bits_per_byte"
:
3.16238943008513e-05
,
"byte_perplexity"
:
1.0000316243943415
,
"word_perplexity"
:
1.000203169094218
}},
"versions"
:
{
"pile_freelaw"
:
0
}}
\ No newline at end of file
tests/testdata/pile_freelaw-v1-loglikelihood_rolling
View file @
121b7096
d77f3f68aadd6cbf1290c2f6737b2ed5d5c2a60e4c81a65c280f207783caabe1
d77f3f68aadd6cbf1290c2f6737b2ed5d5c2a60e4c81a65c280f207783caabe1
\ No newline at end of file
tests/testdata/pile_freelaw-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_freelaw"
:
{
"bits_per_byte"
:
4.5623635481434923e-05
,
"byte_perplexity"
:
1.0000316243943415
,
"word_perplexity"
:
1.000203169094218
}},
"versions"
:
{
"pile_freelaw"
:
1
}}
{
"results"
:
{
"pile_freelaw"
:
{
"bits_per_byte"
:
4.5623635481434923e-05
,
"byte_perplexity"
:
1.0000316243943415
,
"word_perplexity"
:
1.000203169094218
}},
"versions"
:
{
"pile_freelaw"
:
1
}}
\ No newline at end of file
tests/testdata/pile_github-v0-loglikelihood_rolling
View file @
121b7096
df384c3df3d8f53273e97127c5bb84c17e638acad7d6bc9c91f6dee96d43b639
df384c3df3d8f53273e97127c5bb84c17e638acad7d6bc9c91f6dee96d43b639
\ No newline at end of file
tests/testdata/pile_github-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_github"
:
{
"bits_per_byte"
:
9.540627613754646e-05
,
"byte_perplexity"
:
1.0000954108274611
,
"word_perplexity"
:
1.0009643183931227
}},
"versions"
:
{
"pile_github"
:
0
}}
{
"results"
:
{
"pile_github"
:
{
"bits_per_byte"
:
9.540627613754646e-05
,
"byte_perplexity"
:
1.0000954108274611
,
"word_perplexity"
:
1.0009643183931227
}},
"versions"
:
{
"pile_github"
:
0
}}
\ No newline at end of file
tests/testdata/pile_github-v1-loglikelihood_rolling
View file @
121b7096
df384c3df3d8f53273e97127c5bb84c17e638acad7d6bc9c91f6dee96d43b639
df384c3df3d8f53273e97127c5bb84c17e638acad7d6bc9c91f6dee96d43b639
\ No newline at end of file
tests/testdata/pile_github-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_github"
:
{
"bits_per_byte"
:
0.00013764216145332133
,
"byte_perplexity"
:
1.0000954108274611
,
"word_perplexity"
:
1.0009643183931227
}},
"versions"
:
{
"pile_github"
:
1
}}
{
"results"
:
{
"pile_github"
:
{
"bits_per_byte"
:
0.00013764216145332133
,
"byte_perplexity"
:
1.0000954108274611
,
"word_perplexity"
:
1.0009643183931227
}},
"versions"
:
{
"pile_github"
:
1
}}
\ No newline at end of file
tests/testdata/pile_gutenberg-v0-loglikelihood_rolling
View file @
121b7096
02a559f74a9105145e7d4d9c5ddea372b5b4938f5368dc8ffafc39cbe3b4c7ef
02a559f74a9105145e7d4d9c5ddea372b5b4938f5368dc8ffafc39cbe3b4c7ef
\ No newline at end of file
tests/testdata/pile_gutenberg-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_gutenberg"
:
{
"bits_per_byte"
:
1.2443606332351536e-06
,
"byte_perplexity"
:
1.0000012443614075
,
"word_perplexity"
:
1.0000072174665404
}},
"versions"
:
{
"pile_gutenberg"
:
0
}}
{
"results"
:
{
"pile_gutenberg"
:
{
"bits_per_byte"
:
1.2443606332351536e-06
,
"byte_perplexity"
:
1.0000012443614075
,
"word_perplexity"
:
1.0000072174665404
}},
"versions"
:
{
"pile_gutenberg"
:
0
}}
\ No newline at end of file
tests/testdata/pile_gutenberg-v1-loglikelihood_rolling
View file @
121b7096
02a559f74a9105145e7d4d9c5ddea372b5b4938f5368dc8ffafc39cbe3b4c7ef
02a559f74a9105145e7d4d9c5ddea372b5b4938f5368dc8ffafc39cbe3b4c7ef
\ No newline at end of file
tests/testdata/pile_gutenberg-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_gutenberg"
:
{
"bits_per_byte"
:
1.7952329146458065e-06
,
"byte_perplexity"
:
1.0000012443614075
,
"word_perplexity"
:
1.0000072174665404
}},
"versions"
:
{
"pile_gutenberg"
:
1
}}
{
"results"
:
{
"pile_gutenberg"
:
{
"bits_per_byte"
:
1.7952329146458065e-06
,
"byte_perplexity"
:
1.0000012443614075
,
"word_perplexity"
:
1.0000072174665404
}},
"versions"
:
{
"pile_gutenberg"
:
1
}}
\ No newline at end of file
Prev
1
…
17
18
19
20
21
22
23
24
25
…
37
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment