GitLab

Co-authored by: julien_c <chaumond@gmail.com>

Refactoring old run_swag.py

Run multiple choice merge

# Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.

# Conflicts:
#	examples/contrib/run_swag.py

Run multiple choice add doc

# Conflicts:
#	pytorch_transformers/__init__.py

fixed: hard coding for max and min number will out of range in fp16, which will cause nan.

merege from original repo

changes in evaluate function in run_lm_finetuning.py

Fix to prevent crashing on assert len(tokens_b)>=1

Fixing typo in gpt2 for doc site's class link

Trying to fix the head masking test