Unverified Commit 5a5af22e authored by Romain Rigaux's avatar Romain Rigaux Committed by GitHub
Browse files

[docs] Fix wrong newline in the middle of a paragraph (#6573)

parent 7659a8eb
......@@ -53,7 +53,6 @@ The tokenizer can decode a list of token ids in a proper sentence:
As you can see, the tokenizer automatically added some special tokens that the model expect. Not all model need special
tokens; for instance, if we had used` gtp2-medium` instead of `bert-base-cased` to create our tokenizer, we would have
seen the same sentence as the original one here. You can disable this behavior (which is only advised if you have added
those special tokens yourself) by passing ``add_special_tokens=False``.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment