Add tests to make sure task definitions don't change without the version also changing

17c825d1 · Leo Gao · 105fa974 · 17c825d1 · 17c825d1 · 17c825d1
Commit 17c825d1 authored Jun 04, 2021 by Leo Gao
19 changed files
--- a/tests/testdata/wmt20-ja-en-v0-res.json
+++ b/tests/testdata/wmt20-ja-en-v0-res.json
--- a/tests/testdata/wmt20-km-en-v0-greedy_until.json
+++ b/tests/testdata/wmt20-km-en-v0-greedy_until.json
--- a/tests/testdata/wmt20-km-en-v0-res.json
+++ b/tests/testdata/wmt20-km-en-v0-res.json
--- a/tests/testdata/wmt20-pl-en-v0-greedy_until.json
+++ b/tests/testdata/wmt20-pl-en-v0-greedy_until.json
--- a/tests/testdata/wmt20-pl-en-v0-res.json
+++ b/tests/testdata/wmt20-pl-en-v0-res.json
--- a/tests/testdata/wmt20-ps-en-v0-greedy_until.json
+++ b/tests/testdata/wmt20-ps-en-v0-greedy_until.json
--- a/tests/testdata/wmt20-ps-en-v0-res.json
+++ b/tests/testdata/wmt20-ps-en-v0-res.json
--- a/tests/testdata/wmt20-ru-en-v0-greedy_until.json
+++ b/tests/testdata/wmt20-ru-en-v0-greedy_until.json
--- a/tests/testdata/wmt20-ru-en-v0-res.json
+++ b/tests/testdata/wmt20-ru-en-v0-res.json
--- a/tests/testdata/wmt20-ta-en-v0-greedy_until.json
+++ b/tests/testdata/wmt20-ta-en-v0-greedy_until.json
--- a/tests/testdata/wmt20-ta-en-v0-res.json
+++ b/tests/testdata/wmt20-ta-en-v0-res.json
--- a/tests/testdata/wmt20-zh-en-v0-greedy_until.json
+++ b/tests/testdata/wmt20-zh-en-v0-greedy_until.json
--- a/tests/testdata/wmt20-zh-en-v0-res.json
+++ b/tests/testdata/wmt20-zh-en-v0-res.json
--- a/tests/testdata/wnli-v0-loglikelihood.json
+++ b/tests/testdata/wnli-v0-loglikelihood.json
--- a/tests/testdata/wnli-v0-res.json
+++ b/tests/testdata/wnli-v0-res.json
--- a/tests/testdata/wsc-v0-loglikelihood.json
+++ b/tests/testdata/wsc-v0-loglikelihood.json
--- a/tests/testdata/wsc-v0-res.json
+++ b/tests/testdata/wsc-v0-res.json
--- a/tests/testdata/wsc273-v0-loglikelihood.json
+++ b/tests/testdata/wsc273-v0-loglikelihood.json
--- a/tests/testdata/wsc273-v0-res.json
+++ b/tests/testdata/wsc273-v0-res.json