Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
121b7096
Commit
121b7096
authored
May 02, 2022
by
Fabrizio Milo
Browse files
add pre-commit
parent
7a038118
Changes
732
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/wmt20-en-pl-v0-greedy_until
tests/testdata/wmt20-en-pl-v0-greedy_until
+1
-1
tests/testdata/wmt20-en-pl-v0-res.json
tests/testdata/wmt20-en-pl-v0-res.json
+1
-1
tests/testdata/wmt20-en-ps-v0-greedy_until
tests/testdata/wmt20-en-ps-v0-greedy_until
+1
-1
tests/testdata/wmt20-en-ps-v0-res.json
tests/testdata/wmt20-en-ps-v0-res.json
+1
-1
tests/testdata/wmt20-en-ru-v0-greedy_until
tests/testdata/wmt20-en-ru-v0-greedy_until
+1
-1
tests/testdata/wmt20-en-ru-v0-res.json
tests/testdata/wmt20-en-ru-v0-res.json
+1
-1
tests/testdata/wmt20-en-ta-v0-greedy_until
tests/testdata/wmt20-en-ta-v0-greedy_until
+1
-1
tests/testdata/wmt20-en-ta-v0-res.json
tests/testdata/wmt20-en-ta-v0-res.json
+1
-1
tests/testdata/wmt20-en-zh-v0-greedy_until
tests/testdata/wmt20-en-zh-v0-greedy_until
+1
-1
tests/testdata/wmt20-en-zh-v0-res.json
tests/testdata/wmt20-en-zh-v0-res.json
+1
-1
tests/testdata/wmt20-en-zh-v1-greedy_until
tests/testdata/wmt20-en-zh-v1-greedy_until
+1
-1
tests/testdata/wmt20-en-zh-v1-res.json
tests/testdata/wmt20-en-zh-v1-res.json
+1
-1
tests/testdata/wmt20-fr-de-v0-greedy_until
tests/testdata/wmt20-fr-de-v0-greedy_until
+1
-1
tests/testdata/wmt20-fr-de-v0-res.json
tests/testdata/wmt20-fr-de-v0-res.json
+1
-1
tests/testdata/wmt20-iu-en-v0-greedy_until
tests/testdata/wmt20-iu-en-v0-greedy_until
+1
-1
tests/testdata/wmt20-iu-en-v0-res.json
tests/testdata/wmt20-iu-en-v0-res.json
+1
-1
tests/testdata/wmt20-ja-en-v0-greedy_until
tests/testdata/wmt20-ja-en-v0-greedy_until
+1
-1
tests/testdata/wmt20-ja-en-v0-res.json
tests/testdata/wmt20-ja-en-v0-res.json
+1
-1
tests/testdata/wmt20-km-en-v0-greedy_until
tests/testdata/wmt20-km-en-v0-greedy_until
+1
-1
tests/testdata/wmt20-km-en-v0-res.json
tests/testdata/wmt20-km-en-v0-res.json
+1
-1
No files found.
tests/testdata/wmt20-en-pl-v0-greedy_until
View file @
121b7096
952f02575d4936d93c4d2808d86c4bf5f1f3a0901212acee6cbc1f9cbd30d39e
952f02575d4936d93c4d2808d86c4bf5f1f3a0901212acee6cbc1f9cbd30d39e
\ No newline at end of file
tests/testdata/wmt20-en-pl-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-en-pl"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.009006977773147825
,
"chrf_stderr"
:
0.00023387733367766675
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-pl"
:
0
}}
{
"results"
:
{
"wmt20-en-pl"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.009006977773147825
,
"chrf_stderr"
:
0.00023387733367766675
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-pl"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-en-ps-v0-greedy_until
View file @
121b7096
8411c2cb73114cbd0c6e0f17eab2625d486cc3a601105deb0ea1338a401df689
8411c2cb73114cbd0c6e0f17eab2625d486cc3a601105deb0ea1338a401df689
\ No newline at end of file
tests/testdata/wmt20-en-ps-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-en-ps"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
2.1193813610582323e-06
,
"chrf_stderr"
:
2.113911466119111e-06
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-ps"
:
0
}}
{
"results"
:
{
"wmt20-en-ps"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
2.1193813610582323e-06
,
"chrf_stderr"
:
2.113911466119111e-06
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-ps"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-en-ru-v0-greedy_until
View file @
121b7096
a1613831f69c1679a54670092af40ce76617b79d7cc837984803b0fc52bb8bde
a1613831f69c1679a54670092af40ce76617b79d7cc837984803b0fc52bb8bde
\ No newline at end of file
tests/testdata/wmt20-en-ru-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-en-ru"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.0007327811114614671
,
"chrf_stderr"
:
4.43155903515048e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-ru"
:
0
}}
{
"results"
:
{
"wmt20-en-ru"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.0007327811114614671
,
"chrf_stderr"
:
4.43155903515048e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-ru"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-en-ta-v0-greedy_until
View file @
121b7096
5fc556fa90bca7f1b1396e97e392eac8080b0ad53488358799b8fc0b21a94cb1
5fc556fa90bca7f1b1396e97e392eac8080b0ad53488358799b8fc0b21a94cb1
\ No newline at end of file
tests/testdata/wmt20-en-ta-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-en-ta"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.0
,
"chrf_stderr"
:
0.0
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-ta"
:
0
}}
{
"results"
:
{
"wmt20-en-ta"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.0
,
"chrf_stderr"
:
0.0
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-ta"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-en-zh-v0-greedy_until
View file @
121b7096
67f0333ddbcb07d7a9ac12919129a18fe4fea24e4826a11bbdde4fd5ed5ed83f
67f0333ddbcb07d7a9ac12919129a18fe4fea24e4826a11bbdde4fd5ed5ed83f
\ No newline at end of file
tests/testdata/wmt20-en-zh-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-en-zh"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.00014170297316825535
,
"chrf_stderr"
:
6.590669847391838e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-zh"
:
0
}}
{
"results"
:
{
"wmt20-en-zh"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.00014170297316825535
,
"chrf_stderr"
:
6.590669847391838e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-zh"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-en-zh-v1-greedy_until
View file @
121b7096
67f0333ddbcb07d7a9ac12919129a18fe4fea24e4826a11bbdde4fd5ed5ed83f
67f0333ddbcb07d7a9ac12919129a18fe4fea24e4826a11bbdde4fd5ed5ed83f
\ No newline at end of file
tests/testdata/wmt20-en-zh-v1-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-en-zh"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.00014170297316825535
,
"chrf_stderr"
:
6.590669847391838e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-zh"
:
1
}}
{
"results"
:
{
"wmt20-en-zh"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.00014170297316825535
,
"chrf_stderr"
:
6.590669847391838e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-en-zh"
:
1
}}
\ No newline at end of file
tests/testdata/wmt20-fr-de-v0-greedy_until
View file @
121b7096
8a4b65c59dcac6591d46261909ee92ebcf41c19ee7442b12842302b2d8aeb36f
8a4b65c59dcac6591d46261909ee92ebcf41c19ee7442b12842302b2d8aeb36f
\ No newline at end of file
tests/testdata/wmt20-fr-de-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-fr-de"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.01143193767396364
,
"chrf_stderr"
:
0.00012555271954563658
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-fr-de"
:
0
}}
{
"results"
:
{
"wmt20-fr-de"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.01143193767396364
,
"chrf_stderr"
:
0.00012555271954563658
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-fr-de"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-iu-en-v0-greedy_until
View file @
121b7096
97bf664a8efa54b5366b8341f77b418106dd0cb26169d5b2d0144e4d3d2bc5c9
97bf664a8efa54b5366b8341f77b418106dd0cb26169d5b2d0144e4d3d2bc5c9
\ No newline at end of file
tests/testdata/wmt20-iu-en-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-iu-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.012204628007572778
,
"chrf_stderr"
:
8.944407532175802e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-iu-en"
:
0
}}
{
"results"
:
{
"wmt20-iu-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.012204628007572778
,
"chrf_stderr"
:
8.944407532175802e-05
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-iu-en"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-ja-en-v0-greedy_until
View file @
121b7096
1fd846f3c0104e794eb380dae7f648592092ab8bf59234c26d0a671bbbc28df1
1fd846f3c0104e794eb380dae7f648592092ab8bf59234c26d0a671bbbc28df1
\ No newline at end of file
tests/testdata/wmt20-ja-en-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-ja-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.010703148854351403
,
"chrf_stderr"
:
0.00022242113108130186
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-ja-en"
:
0
}}
{
"results"
:
{
"wmt20-ja-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.010703148854351403
,
"chrf_stderr"
:
0.00022242113108130186
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-ja-en"
:
0
}}
\ No newline at end of file
tests/testdata/wmt20-km-en-v0-greedy_until
View file @
121b7096
fb4ec81bb89c70df7e21b43e0e882915b7b71a2a85bb8d4b59e0c7938baaa4c2
fb4ec81bb89c70df7e21b43e0e882915b7b71a2a85bb8d4b59e0c7938baaa4c2
\ No newline at end of file
tests/testdata/wmt20-km-en-v0-res.json
View file @
121b7096
{
"results"
:
{
"wmt20-km-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.015142474534585969
,
"chrf_stderr"
:
0.0001518735048829897
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-km-en"
:
0
}}
{
"results"
:
{
"wmt20-km-en"
:
{
"bleu"
:
0.0
,
"bleu_stderr"
:
0.0
,
"chrf"
:
0.015142474534585969
,
"chrf_stderr"
:
0.0001518735048829897
,
"ter"
:
1.0
,
"ter_stderr"
:
0.0
}},
"versions"
:
{
"wmt20-km-en"
:
0
}}
\ No newline at end of file
Prev
1
…
25
26
27
28
29
30
31
32
33
…
37
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment