Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
4f6e5257
Unverified
Commit
4f6e5257
authored
Sep 19, 2020
by
Stas Bekman
Committed by
GitHub
Sep 19, 2020
Browse files
model card improvements (#7221)
parent
eb074af7
Changes
12
Hide whitespace changes
Inline
Side-by-side
Showing
12 changed files
with
182 additions
and
82 deletions
+182
-82
model_cards/allenai/wmt16-en-de-12-1/README.md
model_cards/allenai/wmt16-en-de-12-1/README.md
+16
-11
model_cards/allenai/wmt16-en-de-dist-12-1/README.md
model_cards/allenai/wmt16-en-de-dist-12-1/README.md
+16
-11
model_cards/allenai/wmt16-en-de-dist-6-1/README.md
model_cards/allenai/wmt16-en-de-dist-6-1/README.md
+16
-11
model_cards/allenai/wmt19-de-en-6-6-base/README.md
model_cards/allenai/wmt19-de-en-6-6-base/README.md
+16
-11
model_cards/allenai/wmt19-de-en-6-6-big/README.md
model_cards/allenai/wmt19-de-en-6-6-big/README.md
+16
-11
model_cards/facebook/wmt19-de-en/README.md
model_cards/facebook/wmt19-de-en/README.md
+14
-1
model_cards/facebook/wmt19-en-de/README.md
model_cards/facebook/wmt19-en-de/README.md
+14
-1
model_cards/facebook/wmt19-en-ru/README.md
model_cards/facebook/wmt19-en-ru/README.md
+14
-1
model_cards/facebook/wmt19-ru-en/README.md
model_cards/facebook/wmt19-ru-en/README.md
+14
-1
scripts/fsmt/gen-card-allenai-wmt16.py
scripts/fsmt/gen-card-allenai-wmt16.py
+16
-11
scripts/fsmt/gen-card-allenai-wmt19.py
scripts/fsmt/gen-card-allenai-wmt19.py
+16
-11
scripts/fsmt/gen-card-facebook-wmt19.py
scripts/fsmt/gen-card-facebook-wmt19.py
+14
-1
No files found.
model_cards/allenai/wmt16-en-de-12-1/README.md
View file @
4f6e5257
...
...
@@ -8,7 +8,7 @@ tags:
-
translation
-
wmt16
-
allenai
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt16
metrics:
...
...
@@ -29,16 +29,6 @@ All 3 models are available:
*
[
wmt16-en-de-dist-6-1
](
https://huggingface.co/allenai/wmt16-en-de-dist-6-1
)
*
[
wmt16-en-de-12-1
](
https://huggingface.co/allenai/wmt16-en-de-12-1
)
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
## Intended uses & limitations
...
...
@@ -97,3 +87,18 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/wm
-
[
training, etc.
](
http://www.statmt.org/wmt16/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
### BibTeX entry and citation info
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
model_cards/allenai/wmt16-en-de-dist-12-1/README.md
View file @
4f6e5257
...
...
@@ -8,7 +8,7 @@ tags:
-
translation
-
wmt16
-
allenai
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt16
metrics:
...
...
@@ -29,16 +29,6 @@ All 3 models are available:
*
[
wmt16-en-de-dist-6-1
](
https://huggingface.co/allenai/wmt16-en-de-dist-6-1
)
*
[
wmt16-en-de-12-1
](
https://huggingface.co/allenai/wmt16-en-de-12-1
)
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
## Intended uses & limitations
...
...
@@ -97,3 +87,18 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/wm
-
[
training, etc.
](
http://www.statmt.org/wmt16/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
### BibTeX entry and citation info
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
model_cards/allenai/wmt16-en-de-dist-6-1/README.md
View file @
4f6e5257
...
...
@@ -8,7 +8,7 @@ tags:
-
translation
-
wmt16
-
allenai
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt16
metrics:
...
...
@@ -29,16 +29,6 @@ All 3 models are available:
*
[
wmt16-en-de-dist-6-1
](
https://huggingface.co/allenai/wmt16-en-de-dist-6-1
)
*
[
wmt16-en-de-12-1
](
https://huggingface.co/allenai/wmt16-en-de-12-1
)
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
## Intended uses & limitations
...
...
@@ -97,3 +87,18 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/wm
-
[
training, etc.
](
http://www.statmt.org/wmt16/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372
)
### BibTeX entry and citation info
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
model_cards/allenai/wmt19-de-en-6-6-base/README.md
View file @
4f6e5257
...
...
@@ -9,7 +9,7 @@ tags:
-
translation
-
wmt19
-
allenai
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt19
metrics:
...
...
@@ -29,16 +29,6 @@ For more details, please, see [Deep Encoder, Shallow Decoder: Reevaluating the S
*
[
wmt19-de-en-6-6-big
](
https://huggingface.co/allenai/wmt19-de-en-6-6-big
)
*
[
wmt19-de-en-6-6-base
](
https://huggingface.co/allenai/wmt19-de-en-6-6-base
)
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
## Intended uses & limitations
...
...
@@ -95,3 +85,18 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/wm
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
### BibTeX entry and citation info
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
model_cards/allenai/wmt19-de-en-6-6-big/README.md
View file @
4f6e5257
...
...
@@ -9,7 +9,7 @@ tags:
-
translation
-
wmt19
-
allenai
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt19
metrics:
...
...
@@ -29,16 +29,6 @@ For more details, please, see [Deep Encoder, Shallow Decoder: Reevaluating the S
*
[
wmt19-de-en-6-6-big
](
https://huggingface.co/allenai/wmt19-de-en-6-6-big
)
*
[
wmt19-de-en-6-6-base
](
https://huggingface.co/allenai/wmt19-de-en-6-6-base
)
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
## Intended uses & limitations
...
...
@@ -95,3 +85,18 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/wm
-
[
training, etc.
](
http://www.statmt.org/wmt19/
)
-
[
test set
](
http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561
)
### BibTeX entry and citation info
```
@misc{kasai2020deep,
title={Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation},
author={Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith},
year={2020},
eprint={2006.10369},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
model_cards/facebook/wmt19-de-en/README.md
View file @
4f6e5257
...
...
@@ -8,7 +8,7 @@ tags:
-
translation
-
wmt19
-
facebook
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt19
metrics:
...
...
@@ -92,6 +92,19 @@ note: fairseq reports using a beam of 50, so you should get a slightly higher sc
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
### BibTeX entry and citation info
```bibtex
@inproceedings{...,
year={2020},
title={Facebook FAIR's WMT19 News Translation Task Submission},
author={Ng, Nathan and Yee, Kyra and Baevski, Alexei and Ott, Myle and Auli, Michael and Edunov, Sergey},
booktitle={Proc. of WMT},
}
``
`
## TODO
-
port model ensemble (fairseq uses 4 model checkpoints)
...
...
model_cards/facebook/wmt19-en-de/README.md
View file @
4f6e5257
...
...
@@ -8,7 +8,7 @@ tags:
-
translation
-
wmt19
-
facebook
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt19
metrics:
...
...
@@ -92,6 +92,19 @@ note: fairseq reports using a beam of 50, so you should get a slightly higher sc
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
### BibTeX entry and citation info
```bibtex
@inproceedings{...,
year={2020},
title={Facebook FAIR's WMT19 News Translation Task Submission},
author={Ng, Nathan and Yee, Kyra and Baevski, Alexei and Ott, Myle and Auli, Michael and Edunov, Sergey},
booktitle={Proc. of WMT},
}
``
`
## TODO
-
port model ensemble (fairseq uses 4 model checkpoints)
...
...
model_cards/facebook/wmt19-en-ru/README.md
View file @
4f6e5257
...
...
@@ -8,7 +8,7 @@ tags:
-
translation
-
wmt19
-
facebook
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt19
metrics:
...
...
@@ -92,6 +92,19 @@ note: fairseq reports using a beam of 50, so you should get a slightly higher sc
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
### BibTeX entry and citation info
```bibtex
@inproceedings{...,
year={2020},
title={Facebook FAIR's WMT19 News Translation Task Submission},
author={Ng, Nathan and Yee, Kyra and Baevski, Alexei and Ott, Myle and Auli, Michael and Edunov, Sergey},
booktitle={Proc. of WMT},
}
``
`
## TODO
-
port model ensemble (fairseq uses 4 model checkpoints)
...
...
model_cards/facebook/wmt19-ru-en/README.md
View file @
4f6e5257
...
...
@@ -8,7 +8,7 @@ tags:
-
translation
-
wmt19
-
facebook
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
-
wmt19
metrics:
...
...
@@ -92,6 +92,19 @@ note: fairseq reports using a beam of 50, so you should get a slightly higher sc
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
### BibTeX entry and citation info
```bibtex
@inproceedings{...,
year={2020},
title={Facebook FAIR's WMT19 News Translation Task Submission},
author={Ng, Nathan and Yee, Kyra and Baevski, Alexei and Ott, Myle and Auli, Michael and Edunov, Sergey},
booktitle={Proc. of WMT},
}
``
`
## TODO
-
port model ensemble (fairseq uses 4 model checkpoints)
...
...
scripts/fsmt/gen-card-allenai-wmt16.py
View file @
4f6e5257
...
...
@@ -33,7 +33,7 @@ tags:
- translation
- wmt16
- allenai
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
- wmt16
metrics:
...
...
@@ -54,16 +54,6 @@ All 3 models are available:
* [wmt16-en-de-dist-6-1](https://huggingface.co/allenai/wmt16-en-de-dist-6-1)
* [wmt16-en-de-12-1](https://huggingface.co/allenai/wmt16-en-de-12-1)
```
@misc{{kasai2020deep,
title={{Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation}},
author={{Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith}},
year={{2020}},
eprint={{2006.10369}},
archivePrefix={{arXiv}},
primaryClass={{cs.CL}}
}}
```
## Intended uses & limitations
...
...
@@ -122,6 +112,21 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/{m
- [training, etc.](http://www.statmt.org/wmt16/)
- [test set](http://matrix.statmt.org/test_sets/newstest2016.tgz?1504722372)
### BibTeX entry and citation info
```
@misc{{kasai2020deep,
title={{Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation}},
author={{Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith}},
year={{2020}},
eprint={{2006.10369}},
archivePrefix={{arXiv}},
primaryClass={{cs.CL}}
}}
```
"""
model_card_dir
.
mkdir
(
parents
=
True
,
exist_ok
=
True
)
path
=
os
.
path
.
join
(
model_card_dir
,
"README.md"
)
...
...
scripts/fsmt/gen-card-allenai-wmt19.py
View file @
4f6e5257
...
...
@@ -33,7 +33,7 @@ tags:
- translation
- wmt19
- allenai
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
- wmt19
metrics:
...
...
@@ -53,16 +53,6 @@ For more details, please, see [Deep Encoder, Shallow Decoder: Reevaluating the S
* [wmt19-de-en-6-6-big](https://huggingface.co/allenai/wmt19-de-en-6-6-big)
* [wmt19-de-en-6-6-base](https://huggingface.co/allenai/wmt19-de-en-6-6-base)
```
@misc{{kasai2020deep,
title={{Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation}},
author={{Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith}},
year={{2020}},
eprint={{2006.10369}},
archivePrefix={{arXiv}},
primaryClass={{cs.CL}}
}}
```
## Intended uses & limitations
...
...
@@ -119,6 +109,21 @@ PYTHONPATH="src:examples/seq2seq" python examples/seq2seq/run_eval.py allenai/{m
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
### BibTeX entry and citation info
```
@misc{{kasai2020deep,
title={{Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation}},
author={{Jungo Kasai and Nikolaos Pappas and Hao Peng and James Cross and Noah A. Smith}},
year={{2020}},
eprint={{2006.10369}},
archivePrefix={{arXiv}},
primaryClass={{cs.CL}}
}}
```
"""
model_card_dir
.
mkdir
(
parents
=
True
,
exist_ok
=
True
)
path
=
os
.
path
.
join
(
model_card_dir
,
"README.md"
)
...
...
scripts/fsmt/gen-card-facebook-wmt19.py
View file @
4f6e5257
...
...
@@ -34,7 +34,7 @@ tags:
- translation
- wmt19
- facebook
license:
A
pache
2.0
license:
a
pache
-
2.0
datasets:
- wmt19
metrics:
...
...
@@ -118,6 +118,19 @@ note: fairseq reports using a beam of 50, so you should get a slightly higher sc
- [training, etc.](http://www.statmt.org/wmt19/)
- [test set](http://matrix.statmt.org/test_sets/newstest2019.tgz?1556572561)
### BibTeX entry and citation info
```bibtex
@inproceedings{{...,
year={{2020}},
title={{Facebook FAIR's WMT19 News Translation Task Submission}},
author={{Ng, Nathan and Yee, Kyra and Baevski, Alexei and Ott, Myle and Auli, Michael and Edunov, Sergey}},
booktitle={{Proc. of WMT}},
}}
```
## TODO
- port model ensemble (fairseq uses 4 model checkpoints)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment