- 24 Apr, 2020 1 commit
-
-
Raul Puri authored
-
- 16 Apr, 2020 1 commit
-
-
Mohammad authored
-
- 13 Apr, 2020 1 commit
-
-
Mohammad authored
-
- 08 Apr, 2020 3 commits
-
-
Jared Casper authored
-
Jared Casper authored
-
Jared Casper authored
preprocess_data: - Adds ability to not split sentences. This is used for gpt2 datasets. - Adds ability to create multiple datasets from different json keys, this is current untested. indexed_dataset: - Add new "get" function to get a portion of an entry.
-