"megatron/legacy/model/language_model.py" did not exist on "269f28f72124022b3acbb72d1f8248030c6c5b72"
-
cjlovering authored
- saves the doc idx by order in dataset - saves the full ctx. we can turn this off it is too much memory - saves the idx of the fewshot examples - saves the source (test/val) of the fewshot examples - TODO: We now need to return the pred/target from process_results - TODO: Make it so override-ed process-resutls don't have to re-impl this.
13d53048
