[Tokenizer Doc] Improve tokenizer summary (#8622)

* improve summary * small fixes * cleaned line length * correct "" formatting * apply sylvains suggestions

[Tokenizer Doc] Improve tokenizer summary (#8622)
* improve summary * small fixes * cleaned line length * correct "" formatting * apply sylvains suggestions
cdfa56af · Patrick von Platen · GitHub · 2f9d49b3 · cdfa56af
Unverified Commit cdfa56af authored Nov 18, 2020 by Patrick von Platen Committed by GitHub Nov 18, 2020
Expand all Show whitespace changes
Inline Side-by-side

Showing with 162 additions and 139 deletions

docs/source/tokenizer_summary.rst docs/source/tokenizer_summary.rst +162 -139

No files found.
--- a/docs/source/tokenizer_summary.rst
+++ b/docs/source/tokenizer_summary.rst