"...git@developer.sourcefind.cn:cnjsdfcy/simbricks.git" did not exist on "5aa661c33cc77c5b95a07cf6d139e9bc6f8e6331"
Unverified Commit 8d43c71a authored by Suraj Patil's avatar Suraj Patil Committed by GitHub
Browse files

fix docs for decoder_input_ids (#11466)

* fix docs for decoder_input_ids

* revert the changes for bart and mbart
parent 7ceff67e
...@@ -582,7 +582,7 @@ BART_INPUTS_DOCSTRING = r""" ...@@ -582,7 +582,7 @@ BART_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Bart uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Bart uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -559,7 +559,7 @@ BART_INPUTS_DOCSTRING = r""" ...@@ -559,7 +559,7 @@ BART_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Bart uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Bart uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -546,7 +546,7 @@ BLENDERBOT_INPUTS_DOCSTRING = r""" ...@@ -546,7 +546,7 @@ BLENDERBOT_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Blenderbot uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Blenderbot uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -560,7 +560,7 @@ BLENDERBOT_INPUTS_DOCSTRING = r""" ...@@ -560,7 +560,7 @@ BLENDERBOT_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Blenderbot uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Blenderbot uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -547,7 +547,7 @@ BLENDERBOT_SMALL_INPUTS_DOCSTRING = r""" ...@@ -547,7 +547,7 @@ BLENDERBOT_SMALL_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
BlenderbotSmall uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation. BlenderbotSmall uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation.
If :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see If :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -565,7 +565,7 @@ BLENDERBOT_SMALL_INPUTS_DOCSTRING = r""" ...@@ -565,7 +565,7 @@ BLENDERBOT_SMALL_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
BlenderbotSmall uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation. BlenderbotSmall uses the :obj:`bos_token_id` as the starting token for :obj:`decoder_input_ids` generation.
If :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see If :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -240,7 +240,7 @@ FSMT_INPUTS_DOCSTRING = r""" ...@@ -240,7 +240,7 @@ FSMT_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
FSMT uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If FSMT uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -595,7 +595,7 @@ M2M_100_INPUTS_DOCSTRING = r""" ...@@ -595,7 +595,7 @@ M2M_100_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
M2M100 uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If M2M100 uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -559,7 +559,7 @@ MARIAN_INPUTS_DOCSTRING = r""" ...@@ -559,7 +559,7 @@ MARIAN_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Marian uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Marian uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -594,7 +594,7 @@ MARIAN_INPUTS_DOCSTRING = r""" ...@@ -594,7 +594,7 @@ MARIAN_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Marian uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Marian uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -582,7 +582,7 @@ MBART_INPUTS_DOCSTRING = r""" ...@@ -582,7 +582,7 @@ MBART_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
MBart uses a specific language id token as the starting token for :obj:`decoder_input_ids` generation that MBart uses a specific language id token as the starting token for :obj:`decoder_input_ids` generation that
varies according to source and target language, *e.g.* 25004 for `en_XX`, and 25003 for `de_DE`. If varies according to source and target language, *e.g.* 25004 for `en_XX`, and 25003 for `de_DE`. If
......
...@@ -533,7 +533,7 @@ MBART_INPUTS_DOCSTRING = r""" ...@@ -533,7 +533,7 @@ MBART_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
MBart uses a specific language id token as the starting token for :obj:`decoder_input_ids` generation that MBart uses a specific language id token as the starting token for :obj:`decoder_input_ids` generation that
varies according to source and target language, *e.g.* 25004 for `en_XX`, and 25003 for `de_DE`. If varies according to source and target language, *e.g.* 25004 for `en_XX`, and 25003 for `de_DE`. If
......
...@@ -558,7 +558,7 @@ PEGASUS_INPUTS_DOCSTRING = r""" ...@@ -558,7 +558,7 @@ PEGASUS_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Pegasus uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Pegasus uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -594,7 +594,7 @@ PEGASUS_INPUTS_DOCSTRING = r""" ...@@ -594,7 +594,7 @@ PEGASUS_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
Pegasus uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If Pegasus uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -95,7 +95,7 @@ PROPHETNET_INPUTS_DOCSTRING = r""" ...@@ -95,7 +95,7 @@ PROPHETNET_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
ProphetNet uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If ProphetNet uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -616,7 +616,7 @@ SPEECH_TO_TEXT_INPUTS_DOCSTRING = r""" ...@@ -616,7 +616,7 @@ SPEECH_TO_TEXT_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
SpeechToText uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If SpeechToText uses the :obj:`eos_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
...@@ -1063,7 +1063,7 @@ T5_INPUTS_DOCSTRING = r""" ...@@ -1063,7 +1063,7 @@ T5_INPUTS_DOCSTRING = r"""
:meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for :meth:`transformers.PreTrainedTokenizer.encode` and :meth:`transformers.PreTrainedTokenizer.__call__` for
details. details.
`What are input IDs? <../glossary.html#input-ids>`__ `What are decoder input IDs? <../glossary.html#decoder-input-ids>`__
T5 uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If T5 uses the :obj:`pad_token_id` as the starting token for :obj:`decoder_input_ids` generation. If
:obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see :obj:`past_key_values` is used, optionally only the last :obj:`decoder_input_ids` have to be input (see
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment