GitLab

remove completed sentences from batch and allow batching uneven lengths (with fixes to make padded sequences work correctly in all models)

This reverts commit b2e119c209363e6ff6d2878a69c7d1a507a2e9be.

Improve dataloader speed and deprecate concept of batch_offset (use --sample-without-replacement instead)

- process only last time step during generation
- cache keys and values
- dont apply masking during generation

Changes:
- 7d19e36: Add `--sampling` flag to generate.py to sample instead of doing beam search
- c777340: Add `scripts/average_checkpoints.py` to average multiple checkpoints into a combined model
- 3ea882c: Add `--max-update` option to train.py to stop training after a given number of updates
- small bugfixes for distributed training, LSTM, inverse square root LR scheduler

Update training commands

specify a single GPU setup for IWSLT14