GitLab

add past hidden key states for more efficient language generation & add prepare_inputs for gpt2 and ctrl model

fix repetition penalty error in modeling_utils.py

Fix F841 flake8 warning

fix bug in prepare inputs for language generation for xlm for effective batch_size > 1

Correct tokenization for special and added tokens

revert erroneous fix #2276

Improve setup and requirements

Use -e only in docs targeted at contributors.

If a user copy-pastes  command line with [--editable], they will hit
an error. If they don't know the --editable option, we're giving them
a choice to make before they can move forwards, but this isn't a choice
they need to make right now.

Improve handling of optional imports

This is really just for consistency.

Else, the next line fails with a confusion exception because the spm
variable isn't defined.

ImportError isn't really appropriate when there's no import involved.

Most module use the simpler `raise` version. Normalize those that don't.

Most users don't need it.