Refactor Code samples; Test code samples (#5036)

* Refactor code samples * Test docstrings * Style * Tokenization examples * Run rust of tests * First step to testing source docs * Style and BART comment * Test the remainder of the code samples * Style * let to const * Formatting fixes * Ready for merge * Fix fixture + Style * Fix last tests * Update docs/source/quicktour.rst Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * Addressing @sgugger's comments + Fix MobileBERT in TF Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Refactor Code samples; Test code samples (#5036)
* Refactor code samples * Test docstrings * Style * Tokenization examples * Run rust of tests * First step to testing source docs * Style and BART comment * Test the remainder of the code samples * Style * let to const * Formatting fixes * Ready for merge * Fix fixture + Style * Fix last tests * Update docs/source/quicktour.rst Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * Addressing @sgugger's comments + Fix MobileBERT in TF Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
364a5ae1 · Lysandre Debut · GitHub · 315f464b · 364a5ae1 · 364a5ae1
Unverified Commit 364a5ae1 authored Jun 25, 2020 by Lysandre Debut Committed by GitHub Jun 25, 2020
8 changed files
--- a/src/transformers/modeling_xlm.py
+++ b/src/transformers/modeling_xlm.py
--- a/src/transformers/modeling_xlnet.py
+++ b/src/transformers/modeling_xlnet.py
--- a/src/transformers/tokenization_bart.py
+++ b/src/transformers/tokenization_bart.py
--- a/src/transformers/tokenization_marian.py
+++ b/src/transformers/tokenization_marian.py
--- a/src/transformers/tokenization_reformer.py
+++ b/src/transformers/tokenization_reformer.py
--- a/src/transformers/tokenization_t5.py
+++ b/src/transformers/tokenization_t5.py
--- a/tests/test_doc_samples.py
+++ b/tests/test_doc_samples.py
--- a/tests/test_modeling_tf_xlm.py
+++ b/tests/test_modeling_tf_xlm.py