add max_length to showcase the use of truncation (#8975)

c108d0b5 · Navjot · GitHub · 62d30e05 · c108d0b5
Unverified Commit c108d0b5 authored Dec 07, 2020 by Navjot Committed by GitHub Dec 07, 2020
Show whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

docs/source/quicktour.rst docs/source/quicktour.rst +2 -0

No files found.
--- a/docs/source/quicktour.rst
+++ b/docs/source/quicktour.rst
@@ -182,6 +182,7 @@ and get tensors back. You can specify all of that to the tokenizer:
    ...     ["We are very happy to show you the 🤗 Transformers library.", "We hope you don't hate it."],
    ...     padding=True,
    ...     truncation=True,
+    ...     max_length=512,
    ...     return_tensors="pt"
    ... )
    >>> ## TENSORFLOW CODE
@@ -189,6 +190,7 @@ and get tensors back. You can specify all of that to the tokenizer:
    ...     ["We are very happy to show you the 🤗 Transformers library.", "We hope you don't hate it."],
    ...     padding=True,
    ...     truncation=True,
+    ...     max_length=512,
    ...     return_tensors="tf"
    ... )