GitLab

Move rearranging query_key_value and key_value values in old checkpoints to when the checkpoint is loaded instead of runtime..

Rename --batch-size to --micro-batch-size and drop in-minibatch from --num-micro-batches-in-minibatch