GitLab

Fast tokenizers

This ensures compatibility with zsh.

Fix #2316.

As we discussed, this is handled here directly 
cc @thomwolf

Typo in serving.py

fix repetition penalty error in modeling_utils.py

Fix F841 flake8 warning

fix bug in prepare inputs for language generation for xlm for effective batch_size > 1

Correct tokenization for special and added tokens

revert erroneous fix #2276

Improve setup and requirements

Use -e only in docs targeted at contributors.

If a user copy-pastes  command line with [--editable], they will hit
an error. If they don't know the --editable option, we're giving them
a choice to make before they can move forwards, but this isn't a choice
they need to make right now.

Improve handling of optional imports