GitLab

This reverts commit de5e5682.

fixed BertForMultipleChoice model init and forward pass

Docs for new learning rate code

Fix training schedules in examples to match new API

- added some images for illustration
- updated comments in optimization

Hubconf

Fix --reduce_memory in finetune_on_pregenerated

Fix indentation weirdness in GPT-2 example.

Learning rate schedules improvement + extension

Pulling commits from main repo

- removed unused plotting code
- using ABC for LRSchedule
- added some schedule object init tests

Updating network handling