Commit 339fc51a authored by Sylvain Gugger's avatar Sylvain Gugger
Browse files

fix styling

parent 4c41c662
...@@ -54,8 +54,8 @@ class PegasusTokenizerFast(PreTrainedTokenizerFast): ...@@ -54,8 +54,8 @@ class PegasusTokenizerFast(PreTrainedTokenizerFast):
Construct a "fast" PEGASUS tokenizer (backed by HuggingFace's `tokenizers` library). Based on `Unigram Construct a "fast" PEGASUS tokenizer (backed by HuggingFace's `tokenizers` library). Based on `Unigram
<https://huggingface.co/docs/tokenizers/python/latest/components.html?highlight=unigram#models>`__. <https://huggingface.co/docs/tokenizers/python/latest/components.html?highlight=unigram#models>`__.
This tokenizer inherits from :class:`~transformers.PreTrainedTokenizerFast` which contains most of the main methods. This tokenizer inherits from :class:`~transformers.PreTrainedTokenizerFast` which contains most of the main
Users should refer to this superclass for more information regarding those methods. methods. Users should refer to this superclass for more information regarding those methods.
Args: Args:
vocab_file (:obj:`str`): vocab_file (:obj:`str`):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment