GitLab

Checkpoint should be saved only after evaluation pass is run to make sure validation losses are identical after loading checkpoint

Add the option for fp32 residual connection (fp32 residual connection machinery still needs to be added)

Rename --batch-size to --micro-batch-size and drop in-minibatch from --num-micro-batches-in-minibatch