GitLab

Reason for issue was that optimzation steps where computed from example size, which is different from actual size of dataloader when an example is chunked into multiple instances.

Solution in this pull request is to compute num_optimization_steps directly from len(data_loader).

small fix to remove shifting of lm labels during pre process of roc stories, as this shifting happens interanlly in the model