"include/ck/library/utility/check_err.hpp" did not exist on "d8415a96b3deaed16c69a46a1022f2a590f11738"
- 08 Apr, 2020 2 commits
-
-
Jared Casper authored
-
Jared Casper authored
preprocess_data: - Adds ability to not split sentences. This is used for gpt2 datasets. - Adds ability to create multiple datasets from different json keys, this is current untested. indexed_dataset: - Add new "get" function to get a portion of an entry.
-
