Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
edbaad2c
Unverified
Commit
edbaad2c
authored
Sep 17, 2020
by
Stas Bekman
Committed by
GitHub
Sep 17, 2020
Browse files
[model cards] fix metadata - 3rd attempt (#7218)
parent
999a1c95
Changes
12
Hide whitespace changes
Inline
Side-by-side
Showing
12 changed files
with
72 additions
and
40 deletions
+72
-40
model_cards/allenai/wmt16-en-de-12-1/README.md
model_cards/allenai/wmt16-en-de-12-1/README.md
+6
-4
model_cards/allenai/wmt16-en-de-dist-12-1/README.md
model_cards/allenai/wmt16-en-de-dist-12-1/README.md
+6
-4
model_cards/allenai/wmt16-en-de-dist-6-1/README.md
model_cards/allenai/wmt16-en-de-dist-6-1/README.md
+6
-4
model_cards/allenai/wmt19-de-en-6-6-base/README.md
model_cards/allenai/wmt19-de-en-6-6-base/README.md
+6
-3
model_cards/allenai/wmt19-de-en-6-6-big/README.md
model_cards/allenai/wmt19-de-en-6-6-big/README.md
+6
-3
model_cards/facebook/wmt19-de-en/README.md
model_cards/facebook/wmt19-de-en/README.md
+6
-3
model_cards/facebook/wmt19-en-de/README.md
model_cards/facebook/wmt19-en-de/README.md
+6
-3
model_cards/facebook/wmt19-en-ru/README.md
model_cards/facebook/wmt19-en-ru/README.md
+6
-3
model_cards/facebook/wmt19-ru-en/README.md
model_cards/facebook/wmt19-ru-en/README.md
+6
-3
scripts/fsmt/gen-card-allenai-wmt16.py
scripts/fsmt/gen-card-allenai-wmt16.py
+6
-4
scripts/fsmt/gen-card-allenai-wmt19.py
scripts/fsmt/gen-card-allenai-wmt19.py
+6
-3
scripts/fsmt/gen-card-facebook-wmt19.py
scripts/fsmt/gen-card-facebook-wmt19.py
+6
-3
No files found.
model_cards/allenai/wmt16-en-de-12-1/README.md
View file @
edbaad2c
...
...
@@ -10,11 +10,9 @@ tags:
-
allenai
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt16/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
-
wmt16
metrics:
-
http://www.statmt.org/wmt16/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -95,3 +93,7 @@ echo $PAIR
PYTHONPATH
=
"src:examples/seq2seq"
python examples/seq2seq/run_eval.py allenai/wmt16-en-de-12-1
$DATA_DIR
/val.source
$SAVE_DIR
/test_translations.txt
--reference_path
$DATA_DIR
/val.target
--score_path
$SAVE_DIR
/test_bleu.json
--bs
$BS
--task
translation
--num_beams
$NUM_BEAMS
```
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt16/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
model_cards/allenai/wmt16-en-de-dist-12-1/README.md
View file @
edbaad2c
...
...
@@ -10,11 +10,9 @@ tags:
-
allenai
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt16/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
-
wmt16
metrics:
-
http://www.statmt.org/wmt16/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -95,3 +93,7 @@ echo $PAIR
PYTHONPATH
=
"src:examples/seq2seq"
python examples/seq2seq/run_eval.py allenai/wmt16-en-de-dist-12-1
$DATA_DIR
/val.source
$SAVE_DIR
/test_translations.txt
--reference_path
$DATA_DIR
/val.target
--score_path
$SAVE_DIR
/test_bleu.json
--bs
$BS
--task
translation
--num_beams
$NUM_BEAMS
```
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt16/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
model_cards/allenai/wmt16-en-de-dist-6-1/README.md
View file @
edbaad2c
...
...
@@ -10,11 +10,9 @@ tags:
-
allenai
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt16/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
-
wmt16
metrics:
-
http://www.statmt.org/wmt16/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -95,3 +93,7 @@ echo $PAIR
PYTHONPATH
=
"src:examples/seq2seq"
python examples/seq2seq/run_eval.py allenai/wmt16-en-de-dist-6-1
$DATA_DIR
/val.source
$SAVE_DIR
/test_translations.txt
--reference_path
$DATA_DIR
/val.target
--score_path
$SAVE_DIR
/test_bleu.json
--bs
$BS
--task
translation
--num_beams
$NUM_BEAMS
```
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt16/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
model_cards/allenai/wmt19-de-en-6-6-base/README.md
View file @
edbaad2c
...
...
@@ -11,10 +11,9 @@ tags:
-
allenai
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt19/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
-
wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -92,3 +91,7 @@ echo $PAIR
PYTHONPATH
=
"src:examples/seq2seq"
python examples/seq2seq/run_eval.py allenai/wmt19-de-en-6-6-base
$DATA_DIR
/val.source
$SAVE_DIR
/test_translations.txt
--reference_path
$DATA_DIR
/val.target
--score_path
$SAVE_DIR
/test_bleu.json
--bs
$BS
--task
translation
--num_beams
$NUM_BEAMS
```
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
model_cards/allenai/wmt19-de-en-6-6-big/README.md
View file @
edbaad2c
...
...
@@ -11,10 +11,9 @@ tags:
-
allenai
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt19/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
-
wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -92,3 +91,7 @@ echo $PAIR
PYTHONPATH
=
"src:examples/seq2seq"
python examples/seq2seq/run_eval.py allenai/wmt19-de-en-6-6-big
$DATA_DIR
/val.source
$SAVE_DIR
/test_translations.txt
--reference_path
$DATA_DIR
/val.target
--score_path
$SAVE_DIR
/test_bleu.json
--bs
$BS
--task
translation
--num_beams
$NUM_BEAMS
```
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
model_cards/facebook/wmt19-de-en/README.md
View file @
edbaad2c
...
...
@@ -10,10 +10,9 @@ tags:
-
facebook
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt19/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
-
wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -88,6 +87,10 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py facebook/w
```
note: fairseq reports using a beam of 50, so you should get a slightly higher score if re-run with `
--num_beams 50
`
.
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
## TODO
...
...
model_cards/facebook/wmt19-en-de/README.md
View file @
edbaad2c
...
...
@@ -10,10 +10,9 @@ tags:
-
facebook
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt19/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
-
wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -88,6 +87,10 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py facebook/w
```
note: fairseq reports using a beam of 50, so you should get a slightly higher score if re-run with `
--num_beams 50
`
.
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
## TODO
...
...
model_cards/facebook/wmt19-en-ru/README.md
View file @
edbaad2c
...
...
@@ -10,10 +10,9 @@ tags:
-
facebook
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt19/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
-
wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -88,6 +87,10 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py facebook/w
```
note: fairseq reports using a beam of 50, so you should get a slightly higher score if re-run with `
--num_beams 50
`
.
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
## TODO
...
...
model_cards/facebook/wmt19-ru-en/README.md
View file @
edbaad2c
...
...
@@ -10,10 +10,9 @@ tags:
-
facebook
license: Apache 2.0
datasets:
-
[
main source
](
http://www.statmt.org/wmt19/
)
-
[
test-set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
-
wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -88,6 +87,10 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py facebook/w
```
note: fairseq reports using a beam of 50, so you should get a slightly higher score if re-run with `
--num_beams 50
`
.
## Data Sources
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
## TODO
...
...
scripts/fsmt/gen-card-allenai-wmt16.py
View file @
edbaad2c
...
...
@@ -35,11 +35,9 @@ tags:
- allenai
license: Apache 2.0
datasets:
- [main source](http://www.statmt.org/wmt16/)
- [test-set](http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372)
- wmt16
metrics:
-
http://www.statmt.org/wmt16/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -120,6 +118,10 @@ echo $PAIR
PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/
{
model_name
}
$DATA_DIR/val.source $SAVE_DIR/test_translations.txt --reference_path $DATA_DIR/val.target --score_path $SAVE_DIR/test_bleu.json --bs $BS --task translation --num_beams $NUM_BEAMS
```
## Data Sources
- [training, etc.](http://www.statmt.org/wmt16/)
- [test set](http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372)
"""
model_card_dir
.
mkdir
(
parents
=
True
,
exist_ok
=
True
)
path
=
os
.
path
.
join
(
model_card_dir
,
"README.md"
)
...
...
scripts/fsmt/gen-card-allenai-wmt19.py
View file @
edbaad2c
...
...
@@ -35,10 +35,9 @@ tags:
- allenai
license: Apache 2.0
datasets:
- [main source](http://www.statmt.org/wmt19/)
- [test-set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
- wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -116,6 +115,10 @@ echo $PAIR
PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/
{
model_name
}
$DATA_DIR/val.source $SAVE_DIR/test_translations.txt --reference_path $DATA_DIR/val.target --score_path $SAVE_DIR/test_bleu.json --bs $BS --task translation --num_beams $NUM_BEAMS
```
## Data Sources
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
"""
model_card_dir
.
mkdir
(
parents
=
True
,
exist_ok
=
True
)
path
=
os
.
path
.
join
(
model_card_dir
,
"README.md"
)
...
...
scripts/fsmt/gen-card-facebook-wmt19.py
View file @
edbaad2c
...
...
@@ -36,10 +36,9 @@ tags:
- facebook
license: Apache 2.0
datasets:
- [main source](http://www.statmt.org/wmt19/)
- [test-set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
- wmt19
metrics:
-
http://www.statmt.org/wmt19/metrics-task.html
-
bleu
---
# FSMT
...
...
@@ -114,6 +113,10 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py facebook/w
```
note: fairseq reports using a beam of 50, so you should get a slightly higher score if re-run with `--num_beams 50`.
## Data Sources
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
## TODO
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment