GitLab

Reason for issue was that optimzation steps where computed from example size, which is different from actual size of dataloader when an example is chunked into multiple instances.

Solution in this pull request is to compute num_optimization_steps directly from len(data_loader).

Modify 'unambigiously' to 'unambiguously'

delete redundancy line `if args.train`, simplify code.