GitLab

Small fix to remove shifting of lm labels during pre process of RocStories.

Fix #537

small fix to remove shifting of lm labels during pre process of roc stories, as this shifting happens interanlly in the model

Update example files so that tr_loss is not affected by args.gradient…

fixed BertForMultipleChoice model init and forward pass

Docs for new learning rate code

Fix training schedules in examples to match new API

- added some images for illustration
- updated comments in optimization

Hubconf

Fix --reduce_memory in finetune_on_pregenerated

Fix indentation weirdness in GPT-2 example.

Learning rate schedules improvement + extension

Pulling commits from main repo

- removed unused plotting code
- using ABC for LRSchedule
- added some schedule object init tests

Updating network handling

Fix indentation for unconditional generation

Fix gradient overflow issue during attention mask

[run_gpt2.py] temperature should be a float, not int

Gpt2 tokenization