Merge branch 'master' into multilingual

31ebb599 · Stella Biderman · GitHub · 38c04a0f · 8728710c · 31ebb599
Unverified Commit 31ebb599 authored Jan 05, 2022 by Stella Biderman Committed by GitHub Jan 05, 2022
20 changed files
--- a/tests/testdata/pile_opensubtitles-v1-res.json
+++ b/tests/testdata/pile_opensubtitles-v1-res.json
--- a/tests/testdata/pile_openwebtext2-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_openwebtext2-v1-loglikelihood_rolling
--- a/tests/testdata/pile_openwebtext2-v1-res.json
+++ b/tests/testdata/pile_openwebtext2-v1-res.json
--- a/tests/testdata/pile_philpapers-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_philpapers-v1-loglikelihood_rolling
--- a/tests/testdata/pile_philpapers-v1-res.json
+++ b/tests/testdata/pile_philpapers-v1-res.json
--- a/tests/testdata/pile_pile-cc-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_pile-cc-v1-loglikelihood_rolling
--- a/tests/testdata/pile_pile-cc-v1-res.json
+++ b/tests/testdata/pile_pile-cc-v1-res.json
--- a/tests/testdata/pile_pubmed-abstracts-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_pubmed-abstracts-v1-loglikelihood_rolling
--- a/tests/testdata/pile_pubmed-abstracts-v1-res.json
+++ b/tests/testdata/pile_pubmed-abstracts-v1-res.json
--- a/tests/testdata/pile_pubmed-central-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_pubmed-central-v1-loglikelihood_rolling
--- a/tests/testdata/pile_pubmed-central-v1-res.json
+++ b/tests/testdata/pile_pubmed-central-v1-res.json
--- a/tests/testdata/pile_stackexchange-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_stackexchange-v1-loglikelihood_rolling
--- a/tests/testdata/pile_stackexchange-v1-res.json
+++ b/tests/testdata/pile_stackexchange-v1-res.json
--- a/tests/testdata/pile_ubuntu-irc-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_ubuntu-irc-v1-loglikelihood_rolling
--- a/tests/testdata/pile_ubuntu-irc-v1-res.json
+++ b/tests/testdata/pile_ubuntu-irc-v1-res.json
--- a/tests/testdata/pile_uspto-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_uspto-v1-loglikelihood_rolling
--- a/tests/testdata/pile_uspto-v1-res.json
+++ b/tests/testdata/pile_uspto-v1-res.json
--- a/tests/testdata/pile_wikipedia-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_wikipedia-v1-loglikelihood_rolling
--- a/tests/testdata/pile_wikipedia-v1-res.json
+++ b/tests/testdata/pile_wikipedia-v1-res.json
--- a/tests/testdata/pile_youtubesubtitles-v1-loglikelihood_rolling
+++ b/tests/testdata/pile_youtubesubtitles-v1-loglikelihood_rolling