GitLab

[hotfix] Fix frozen pooler parameters in SWAG example.

apply Whole Word Masking technique

apply Whole Word Masking technique.
referred to [create_pretraining_data.py](https://github.com/google-research/bert/blob/master/create_pretraining_data.py)

This reverts commit de5e5682.

Add GPT* compatibility to torchhub

Updating learning rate with special warm up in examples

Make the epsilon of LayerNorm configurable.

move pytroch_pretrained_bert cache folder under same path as torch

Create optimizer only when args.do_train is True

Fix documentation typo