GitLab

We currently initialize `encoder_attention_mask` when it is `None`,
whether the stack is that of an encoder or a decoder. Since this
may lead to bugs that are difficult to tracks down, I added a condition
that assesses whether the current stack is a decoder.

converted from https://github.com/openai/gpt-2-output-dataset/tree/master/detector

Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
Co-Authored-By: Jong Wook Kim <jongwook@nyu.edu>
Co-Authored-By: Jeff Wu <wuthefwasthat@gmail.com>

cf. https://docs.pytest.org/en/latest/example/simple.html

model forwards can take an inputs_embeds param

add progress bar to convert_examples_to_features

Add speed log to examples/run_squad.py

Fixing mode in evaluate during training

It takes considerate amount of time (~10 min) to parse the examples to features, it is good to have a progress-bar to track this

Fix #1623

Co-Authored-By: Santosh-Gupta <San.Gupta.ML@gmail.com>

Add common getter and setter for input_embeddings & output_embeddings

Fix token order in xlnet preprocessing for SQuAD

Fix https://github.com/huggingface/transformers/issues/1673