"megatron/legacy/data/ict_dataset.py" did not exist on "6c0a5bd880780ea630d038b9cf75ee02a8aee408"
-
Matthew Carrigan authored
out on the fly without shuffling - the Sampler in the finetuning script will shuffle for us.
a8a577ba
out on the fly without shuffling - the Sampler in the finetuning script will shuffle for us.