Skip to content

GitLab

"deploy/git@developer.sourcefind.cn:wangsen/paddle_dbnet.git" did not exist on "c6c39e87b21fac3b1f59bde538bd0ca9e18e942f"
Commit 52166f67 authored by Sylvain Gugger's avatar Sylvain Gugger
Browse files

Style

parent 9cac4fab
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
src/transformers/models/roberta/tokenization_roberta.py
View file @ 52166f67
...@@ -81,8 +81,8 @@ class RobertaTokenizer(GPT2Tokenizer): ...@@ -81,8 +81,8 @@ class RobertaTokenizer(GPT2Tokenizer):
When used with ``is_split_into_words=True``, this tokenizer will add a space before each word (even the first When used with ``is_split_into_words=True``, this tokenizer will add a space before each word (even the first
one). one).
This tokenizer inherits from :class:`~transformers.PreTrainedTokenizer` which contains most of the main This tokenizer inherits from :class:`~transformers.PreTrainedTokenizer` which contains most of the main methods.
methods. Users should refer to this superclass for more information regarding those methods. Users should refer to this superclass for more information regarding those methods.
Args: Args:
vocab_file (:obj:`str`): vocab_file (:obj:`str`):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment