GitLab

preprocess_data:
- Adds ability to not split sentences. This is used for gpt2 datasets.

- Adds ability to create multiple datasets from different json keys,
this is current untested.

indexed_dataset:
- Add new "get" function to get a portion of an entry.

Some cleanup of types, etc. in the helpers cpp code.

Also removed the fix_lua_indexing stuff from fairseq.