Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
8c997e53
Commit
8c997e53
authored
May 03, 2022
by
jon-tow
Browse files
Revert `tests/testdata` changes and address flake8 issues
parent
d95a4333
Changes
627
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/wmt14-en-fr-v0-res.json
tests/testdata/wmt14-en-fr-v0-res.json
+1
-1
tests/testdata/wmt14-fr-en-v0-greedy_until
tests/testdata/wmt14-fr-en-v0-greedy_until
+1
-1
tests/testdata/wmt14-fr-en-v0-res.json
tests/testdata/wmt14-fr-en-v0-res.json
+1
-1
tests/testdata/wmt16-de-en-v0-greedy_until
tests/testdata/wmt16-de-en-v0-greedy_until
+1
-1
tests/testdata/wmt16-de-en-v0-res.json
tests/testdata/wmt16-de-en-v0-res.json
+1
-1
tests/testdata/wmt16-en-de-v0-greedy_until
tests/testdata/wmt16-en-de-v0-greedy_until
+1
-1
tests/testdata/wmt16-en-de-v0-res.json
tests/testdata/wmt16-en-de-v0-res.json
+1
-1
tests/testdata/wmt16-en-ro-v0-greedy_until
tests/testdata/wmt16-en-ro-v0-greedy_until
+1
-1
tests/testdata/wmt16-en-ro-v0-res.json
tests/testdata/wmt16-en-ro-v0-res.json
+1
-1
tests/testdata/wmt16-ro-en-v0-greedy_until
tests/testdata/wmt16-ro-en-v0-greedy_until
+1
-1
tests/testdata/wmt16-ro-en-v0-res.json
tests/testdata/wmt16-ro-en-v0-res.json
+1
-1
tests/testdata/wmt20-cs-en-v0-greedy_until
tests/testdata/wmt20-cs-en-v0-greedy_until
+1
-1
tests/testdata/wmt20-cs-en-v0-res.json
tests/testdata/wmt20-cs-en-v0-res.json
+1
-1
tests/testdata/wmt20-de-en-v0-greedy_until
tests/testdata/wmt20-de-en-v0-greedy_until
+1
-1
tests/testdata/wmt20-de-en-v0-res.json
tests/testdata/wmt20-de-en-v0-res.json
+1
-1
tests/testdata/wmt20-de-fr-v0-greedy_until
tests/testdata/wmt20-de-fr-v0-greedy_until
+1
-1
tests/testdata/wmt20-de-fr-v0-res.json
tests/testdata/wmt20-de-fr-v0-res.json
+1
-1
tests/testdata/wmt20-en-cs-v0-greedy_until
tests/testdata/wmt20-en-cs-v0-greedy_until
+1
-1
tests/testdata/wmt20-en-cs-v0-res.json
tests/testdata/wmt20-en-cs-v0-res.json
+1
-1
tests/testdata/wmt20-en-de-v0-greedy_until
tests/testdata/wmt20-en-de-v0-greedy_until
+1
-1
No files found.
tests/testdata/wmt14-en-fr-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt14-en-fr"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.011284118461117099
,
"chrf_stderr"
:
7.340651275964445e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt14-en-fr"
:
0
}}
{
"results"
:
{
"wmt14-en-fr"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.011284118461117099
,
"chrf_stderr"
:
7.340651275964445e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt14-en-fr"
:
0
}}
\ No newline at end of file
tests/testdata/wmt14-fr-en-v0-greedy_until
View file @
8c997e53
c1d9f7283755fbdd7ecd6cc4278b0ac25a80ac256b7071ea5f839ccd038e5974
c1d9f7283755fbdd7ecd6cc4278b0ac25a80ac256b7071ea5f839ccd038e5974
\ No newline at end of file
tests/testdata/wmt14-fr-en-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt14-fr-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.01275083169440515
,
"chrf_stderr"
:
8.45474998563806e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt14-fr-en"
:
0
}}
{
"results"
:
{
"wmt14-fr-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.01275083169440515
,
"chrf_stderr"
:
8.45474998563806e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt14-fr-en"
:
0
}}
\ No newline at end of file
tests/testdata/wmt16-de-en-v0-greedy_until
View file @
8c997e53
d30e23e38d9a45b9c31e1dfd14b58d0b7020df4b9c8a1c697aa6bc5fba8ce08a
d30e23e38d9a45b9c31e1dfd14b58d0b7020df4b9c8a1c697aa6bc5fba8ce08a
\ No newline at end of file
tests/testdata/wmt16-de-en-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt16-de-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.013700416764482968
,
"chrf_stderr"
:
0.00016071651360909355
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-de-en"
:
0
}}
{
"results"
:
{
"wmt16-de-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.013700416764482968
,
"chrf_stderr"
:
0.00016071651360909355
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-de-en"
:
0
}}
\ No newline at end of file
tests/testdata/wmt16-en-de-v0-greedy_until
View file @
8c997e53
d71e2074af3770e9b29ac561caf2e1c29ad6b0dc50ec2e7bcc5501747b11f0da
d71e2074af3770e9b29ac561caf2e1c29ad6b0dc50ec2e7bcc5501747b11f0da
\ No newline at end of file
tests/testdata/wmt16-en-de-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt16-en-de"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.010909486120840577
,
"chrf_stderr"
:
0.000122611124711072
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-en-de"
:
0
}}
{
"results"
:
{
"wmt16-en-de"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.010909486120840577
,
"chrf_stderr"
:
0.000122611124711072
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-en-de"
:
0
}}
\ No newline at end of file
tests/testdata/wmt16-en-ro-v0-greedy_until
View file @
8c997e53
4be7fdda313394f19b5995b00ada1dfa3bb158ee1f020ef8d07ecea260fa60b2
4be7fdda313394f19b5995b00ada1dfa3bb158ee1f020ef8d07ecea260fa60b2
\ No newline at end of file
tests/testdata/wmt16-en-ro-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt16-en-ro"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.012004814364156886
,
"chrf_stderr"
:
6.424423961332661e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-en-ro"
:
0
}}
{
"results"
:
{
"wmt16-en-ro"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.012004814364156886
,
"chrf_stderr"
:
6.424423961332661e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-en-ro"
:
0
}}
\ No newline at end of file
tests/testdata/wmt16-ro-en-v0-greedy_until
View file @
8c997e53
d1b7c50751b0d5d7470b7f49f2bab9d09792c91460fc92cc34f06617013d7c65
d1b7c50751b0d5d7470b7f49f2bab9d09792c91460fc92cc34f06617013d7c65
\ No newline at end of file
tests/testdata/wmt16-ro-en-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt16-ro-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.01262029828861831
,
"chrf_stderr"
:
0.00014507496111350828
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-ro-en"
:
0
}}
{
"results"
:
{
"wmt16-ro-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.01262029828861831
,
"chrf_stderr"
:
0.00014507496111350828
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt16-ro-en"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-cs-en-v0-greedy_until
View file @
8c997e53
bfead9efdb1b2402a414c55929c8d8f956585f938a35466931d44e81d89cfe00
bfead9efdb1b2402a414c55929c8d8f956585f938a35466931d44e81d89cfe00
\ No newline at end of file
tests/testdata/wmt20-cs-en-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt20-cs-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.006212086270964023
,
"chrf_stderr"
:
0.0001119165191795531
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-cs-en"
:
0
}}
{
"results"
:
{
"wmt20-cs-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.006212086270964023
,
"chrf_stderr"
:
0.0001119165191795531
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-cs-en"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-de-en-v0-greedy_until
View file @
8c997e53
d13b5a6915ca86ac6c6ebc50d9be0d0be3dfca600c12e896df53190d875de74d
d13b5a6915ca86ac6c6ebc50d9be0d0be3dfca600c12e896df53190d875de74d
\ No newline at end of file
tests/testdata/wmt20-de-en-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt20-de-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.006703243310670055
,
"chrf_stderr"
:
0.0001292711927988445
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-de-en"
:
0
}}
{
"results"
:
{
"wmt20-de-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.006703243310670055
,
"chrf_stderr"
:
0.0001292711927988445
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-de-en"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-de-fr-v0-greedy_until
View file @
8c997e53
7f197bc281d6dbf9425900ef0dee7175021c43e355050f149f43b161c52bf0b0
7f197bc281d6dbf9425900ef0dee7175021c43e355050f149f43b161c52bf0b0
\ No newline at end of file
tests/testdata/wmt20-de-fr-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt20-de-fr"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.011897164096796364
,
"chrf_stderr"
:
0.00010158164726118333
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-de-fr"
:
0
}}
{
"results"
:
{
"wmt20-de-fr"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.011897164096796364
,
"chrf_stderr"
:
0.00010158164726118333
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-de-fr"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-en-cs-v0-greedy_until
View file @
8c997e53
5a34e6863bf6965afd31653de50bac5fecf58db65dbaba46921504a2b7463786
5a34e6863bf6965afd31653de50bac5fecf58db65dbaba46921504a2b7463786
\ No newline at end of file
tests/testdata/wmt20-en-cs-v0-res.json
View file @
8c997e53
{
"results"
:
{
"wmt20-en-cs"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.009879653442394573
,
"chrf_stderr"
:
8.210293331159994e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-cs"
:
0
}}
{
"results"
:
{
"wmt20-en-cs"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.009879653442394573
,
"chrf_stderr"
:
8.210293331159994e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-cs"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-en-de-v0-greedy_until
View file @
8c997e53
b6e9c305766ea23ce1027309f83c6d4c2ce8948d70b63a7858586ca34050d7fb
b6e9c305766ea23ce1027309f83c6d4c2ce8948d70b63a7858586ca34050d7fb
\ No newline at end of file
Prev
1
…
25
26
27
28
29
30
31
32
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment