Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
121b7096
Commit
121b7096
authored
May 02, 2022
by
Fabrizio Milo
Browse files
add pre-commit
parent
7a038118
Changes
732
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/pile_pile-cc-v0-loglikelihood_rolling
tests/testdata/pile_pile-cc-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_pile-cc-v0-res.json
tests/testdata/pile_pile-cc-v0-res.json
+1
-1
tests/testdata/pile_pile-cc-v1-loglikelihood_rolling
tests/testdata/pile_pile-cc-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_pile-cc-v1-res.json
tests/testdata/pile_pile-cc-v1-res.json
+1
-1
tests/testdata/pile_pubmed-abstracts-v0-loglikelihood_rolling
...s/testdata/pile_pubmed-abstracts-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_pubmed-abstracts-v0-res.json
tests/testdata/pile_pubmed-abstracts-v0-res.json
+1
-1
tests/testdata/pile_pubmed-abstracts-v1-loglikelihood_rolling
...s/testdata/pile_pubmed-abstracts-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_pubmed-abstracts-v1-res.json
tests/testdata/pile_pubmed-abstracts-v1-res.json
+1
-1
tests/testdata/pile_pubmed-central-v0-loglikelihood_rolling
tests/testdata/pile_pubmed-central-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_pubmed-central-v0-res.json
tests/testdata/pile_pubmed-central-v0-res.json
+1
-1
tests/testdata/pile_pubmed-central-v1-loglikelihood_rolling
tests/testdata/pile_pubmed-central-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_pubmed-central-v1-res.json
tests/testdata/pile_pubmed-central-v1-res.json
+1
-1
tests/testdata/pile_stackexchange-v0-loglikelihood_rolling
tests/testdata/pile_stackexchange-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_stackexchange-v0-res.json
tests/testdata/pile_stackexchange-v0-res.json
+1
-1
tests/testdata/pile_stackexchange-v1-loglikelihood_rolling
tests/testdata/pile_stackexchange-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_stackexchange-v1-res.json
tests/testdata/pile_stackexchange-v1-res.json
+1
-1
tests/testdata/pile_ubuntu-irc-v0-loglikelihood_rolling
tests/testdata/pile_ubuntu-irc-v0-loglikelihood_rolling
+1
-1
tests/testdata/pile_ubuntu-irc-v0-res.json
tests/testdata/pile_ubuntu-irc-v0-res.json
+1
-1
tests/testdata/pile_ubuntu-irc-v1-loglikelihood_rolling
tests/testdata/pile_ubuntu-irc-v1-loglikelihood_rolling
+1
-1
tests/testdata/pile_ubuntu-irc-v1-res.json
tests/testdata/pile_ubuntu-irc-v1-res.json
+1
-1
No files found.
tests/testdata/pile_pile-cc-v0-loglikelihood_rolling
View file @
121b7096
731fdef4a43949b179ba0c540148ebc2fa41583dd583ef580dd812076c66a451
731fdef4a43949b179ba0c540148ebc2fa41583dd583ef580dd812076c66a451
\ No newline at end of file
tests/testdata/pile_pile-cc-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_pile-cc"
:
{
"bits_per_byte"
:
0.00011234131907228174
,
"byte_perplexity"
:
1.0001123476295946
,
"word_perplexity"
:
1.0006738958554477
}},
"versions"
:
{
"pile_pile-cc"
:
0
}}
{
"results"
:
{
"pile_pile-cc"
:
{
"bits_per_byte"
:
0.00011234131907228174
,
"byte_perplexity"
:
1.0001123476295946
,
"word_perplexity"
:
1.0006738958554477
}},
"versions"
:
{
"pile_pile-cc"
:
0
}}
\ No newline at end of file
tests/testdata/pile_pile-cc-v1-loglikelihood_rolling
View file @
121b7096
731fdef4a43949b179ba0c540148ebc2fa41583dd583ef580dd812076c66a451
731fdef4a43949b179ba0c540148ebc2fa41583dd583ef580dd812076c66a451
\ No newline at end of file
tests/testdata/pile_pile-cc-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_pile-cc"
:
{
"bits_per_byte"
:
0.0001620742639125056
,
"byte_perplexity"
:
1.0001123476295946
,
"word_perplexity"
:
1.0006738958554477
}},
"versions"
:
{
"pile_pile-cc"
:
1
}}
{
"results"
:
{
"pile_pile-cc"
:
{
"bits_per_byte"
:
0.0001620742639125056
,
"byte_perplexity"
:
1.0001123476295946
,
"word_perplexity"
:
1.0006738958554477
}},
"versions"
:
{
"pile_pile-cc"
:
1
}}
\ No newline at end of file
tests/testdata/pile_pubmed-abstracts-v0-loglikelihood_rolling
View file @
121b7096
66436569a43163afb2caf422d32c5f329899e74c49865d4d13881fd465fd9976
66436569a43163afb2caf422d32c5f329899e74c49865d4d13881fd465fd9976
\ No newline at end of file
tests/testdata/pile_pubmed-abstracts-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_pubmed-abstracts"
:
{
"bits_per_byte"
:
0.00037553733051528816
,
"byte_perplexity"
:
1.0003756078534862
,
"word_perplexity"
:
1.0025884332779
}},
"versions"
:
{
"pile_pubmed-abstracts"
:
0
}}
{
"results"
:
{
"pile_pubmed-abstracts"
:
{
"bits_per_byte"
:
0.00037553733051528816
,
"byte_perplexity"
:
1.0003756078534862
,
"word_perplexity"
:
1.0025884332779
}},
"versions"
:
{
"pile_pubmed-abstracts"
:
0
}}
\ No newline at end of file
tests/testdata/pile_pubmed-abstracts-v1-loglikelihood_rolling
View file @
121b7096
66436569a43163afb2caf422d32c5f329899e74c49865d4d13881fd465fd9976
66436569a43163afb2caf422d32c5f329899e74c49865d4d13881fd465fd9976
\ No newline at end of file
tests/testdata/pile_pubmed-abstracts-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_pubmed-abstracts"
:
{
"bits_per_byte"
:
0.0005417858444030858
,
"byte_perplexity"
:
1.0003756078534862
,
"word_perplexity"
:
1.0025884332779
}},
"versions"
:
{
"pile_pubmed-abstracts"
:
1
}}
{
"results"
:
{
"pile_pubmed-abstracts"
:
{
"bits_per_byte"
:
0.0005417858444030858
,
"byte_perplexity"
:
1.0003756078534862
,
"word_perplexity"
:
1.0025884332779
}},
"versions"
:
{
"pile_pubmed-abstracts"
:
1
}}
\ No newline at end of file
tests/testdata/pile_pubmed-central-v0-loglikelihood_rolling
View file @
121b7096
40b39d120d99a145690444e86acc3e3e24d41e6e0538a75e26929ad84926e5e0
40b39d120d99a145690444e86acc3e3e24d41e6e0538a75e26929ad84926e5e0
\ No newline at end of file
tests/testdata/pile_pubmed-central-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_pubmed-central"
:
{
"bits_per_byte"
:
1.5812411832795375e-05
,
"byte_perplexity"
:
1.0000158125368497
,
"word_perplexity"
:
1.000123107107861
}},
"versions"
:
{
"pile_pubmed-central"
:
0
}}
{
"results"
:
{
"pile_pubmed-central"
:
{
"bits_per_byte"
:
1.5812411832795375e-05
,
"byte_perplexity"
:
1.0000158125368497
,
"word_perplexity"
:
1.000123107107861
}},
"versions"
:
{
"pile_pubmed-central"
:
0
}}
\ No newline at end of file
tests/testdata/pile_pubmed-central-v1-loglikelihood_rolling
View file @
121b7096
40b39d120d99a145690444e86acc3e3e24d41e6e0538a75e26929ad84926e5e0
40b39d120d99a145690444e86acc3e3e24d41e6e0538a75e26929ad84926e5e0
\ No newline at end of file
tests/testdata/pile_pubmed-central-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_pubmed-central"
:
{
"bits_per_byte"
:
2.2812488135667854e-05
,
"byte_perplexity"
:
1.0000158125368497
,
"word_perplexity"
:
1.000123107107861
}},
"versions"
:
{
"pile_pubmed-central"
:
1
}}
{
"results"
:
{
"pile_pubmed-central"
:
{
"bits_per_byte"
:
2.2812488135667854e-05
,
"byte_perplexity"
:
1.0000158125368497
,
"word_perplexity"
:
1.000123107107861
}},
"versions"
:
{
"pile_pubmed-central"
:
1
}}
\ No newline at end of file
tests/testdata/pile_stackexchange-v0-loglikelihood_rolling
View file @
121b7096
e524bfb3e21cbdaddc117403a50df598520c7bf5b2c60ad8f2372cfa564e79be
e524bfb3e21cbdaddc117403a50df598520c7bf5b2c60ad8f2372cfa564e79be
\ No newline at end of file
tests/testdata/pile_stackexchange-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_stackexchange"
:
{
"bits_per_byte"
:
0.0002288815898835956
,
"byte_perplexity"
:
1.0002289077852733
,
"word_perplexity"
:
1.0016993562258851
}},
"versions"
:
{
"pile_stackexchange"
:
0
}}
{
"results"
:
{
"pile_stackexchange"
:
{
"bits_per_byte"
:
0.0002288815898835956
,
"byte_perplexity"
:
1.0002289077852733
,
"word_perplexity"
:
1.0016993562258851
}},
"versions"
:
{
"pile_stackexchange"
:
0
}}
\ No newline at end of file
tests/testdata/pile_stackexchange-v1-loglikelihood_rolling
View file @
121b7096
e524bfb3e21cbdaddc117403a50df598520c7bf5b2c60ad8f2372cfa564e79be
e524bfb3e21cbdaddc117403a50df598520c7bf5b2c60ad8f2372cfa564e79be
\ No newline at end of file
tests/testdata/pile_stackexchange-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_stackexchange"
:
{
"bits_per_byte"
:
0.0003302063346758449
,
"byte_perplexity"
:
1.0002289077852733
,
"word_perplexity"
:
1.0016993562258851
}},
"versions"
:
{
"pile_stackexchange"
:
1
}}
{
"results"
:
{
"pile_stackexchange"
:
{
"bits_per_byte"
:
0.0003302063346758449
,
"byte_perplexity"
:
1.0002289077852733
,
"word_perplexity"
:
1.0016993562258851
}},
"versions"
:
{
"pile_stackexchange"
:
1
}}
\ No newline at end of file
tests/testdata/pile_ubuntu-irc-v0-loglikelihood_rolling
View file @
121b7096
4eb69e314f0864ec8890e2323d7e76f8a8309692c4f090e2b41bf4be681a811d
4eb69e314f0864ec8890e2323d7e76f8a8309692c4f090e2b41bf4be681a811d
\ No newline at end of file
tests/testdata/pile_ubuntu-irc-v0-res.json
View file @
121b7096
{
"results"
:
{
"pile_ubuntu-irc"
:
{
"bits_per_byte"
:
1.6298315496830533e-06
,
"byte_perplexity"
:
1.0000016298328778
,
"word_perplexity"
:
1.0000108866656874
}},
"versions"
:
{
"pile_ubuntu-irc"
:
0
}}
{
"results"
:
{
"pile_ubuntu-irc"
:
{
"bits_per_byte"
:
1.6298315496830533e-06
,
"byte_perplexity"
:
1.0000016298328778
,
"word_perplexity"
:
1.0000108866656874
}},
"versions"
:
{
"pile_ubuntu-irc"
:
0
}}
\ No newline at end of file
tests/testdata/pile_ubuntu-irc-v1-loglikelihood_rolling
View file @
121b7096
4eb69e314f0864ec8890e2323d7e76f8a8309692c4f090e2b41bf4be681a811d
4eb69e314f0864ec8890e2323d7e76f8a8309692c4f090e2b41bf4be681a811d
\ No newline at end of file
tests/testdata/pile_ubuntu-irc-v1-res.json
View file @
121b7096
{
"results"
:
{
"pile_ubuntu-irc"
:
{
"bits_per_byte"
:
2.3513498942121155e-06
,
"byte_perplexity"
:
1.0000016298328778
,
"word_perplexity"
:
1.0000108866656874
}},
"versions"
:
{
"pile_ubuntu-irc"
:
1
}}
{
"results"
:
{
"pile_ubuntu-irc"
:
{
"bits_per_byte"
:
2.3513498942121155e-06
,
"byte_perplexity"
:
1.0000016298328778
,
"word_perplexity"
:
1.0000108866656874
}},
"versions"
:
{
"pile_ubuntu-irc"
:
1
}}
\ No newline at end of file
Prev
1
…
19
20
21
22
23
24
25
26
27
…
37
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment