GitLab

* Allow more flexible pre-processing and generation

* Addressing CR comments

* small fix

Remove custom ConvTBC code

Oss merge internal changes

* Making our code compatible with the latest pytorch

* revert

* torch.nn.utils.clip_grad_norm now returns tensor

* Add prefix

* Fixes

* Keep original scores with prefix

* Improve prefix code

* Replace 'repeat' with 'expand'

This PR includes breaking API changes to modularize fairseq-py and adds support for distributed training across multiple nodes.

Changes:
- c7033ef: add support for distributed training! See updated README for usage.
- e016299: modularize fairseq-py, adding support for register_model, register_criterion, register_optimizer, etc.
- 154e440: update LSTM implementation to use PackedSequence objects in the encoder, better following best practices and improving perf
- 90c2973 and 1da6265: improve unit test coverage

Prepare scripts for WMT14 (#88)

BLEU ratio should be predlen/reflen not reflen/predlen

To be compatible with multi-bleu.
This seems to only affect the result_string.

See https://arxiv.org/abs/1711.05101