- 12 Nov, 2020 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
Also includes following changes for inter-layer model-parallel implementation: - Refactoring of model implementations - Training loop changes to support inter-layer communication using `ring_exchange` - New groups for inter-layer communication - Checkpoint changes - Command line arguments
-
- 14 Apr, 2020 1 commit
-
-
Neel Kant authored
-
- 13 Apr, 2020 1 commit
-
-
Jared Casper authored
-
- 08 Apr, 2020 1 commit
-
-
Jared Casper authored
preprocess_data: - Adds ability to not split sentences. This is used for gpt2 datasets. - Adds ability to create multiple datasets from different json keys, this is current untested. indexed_dataset: - Add new "get" function to get a portion of an entry.
-
- 13 Nov, 2019 1 commit
-
-
Jared Casper authored
Some cleanup of types, etc. in the helpers cpp code.
-
- 09 Nov, 2019 2 commits
-
-
Jared Casper authored
-
Jared Casper authored
Also removed the fix_lua_indexing stuff from fairseq.
-
- 08 Nov, 2019 1 commit
-
-
Jared Casper authored
-
- 07 Nov, 2019 1 commit
-
-
Jared Casper authored
-