GitLab

model_args should only be things that affect output of the model
therefore, stuff like batch size, device, etc shouldn't be in there

do per character loss aggregation for multiple choice tasks (similar to OAI's per token aggregation)

(or rather, move it to the data download phase)

Now, if a run gets interrupted halfway, you can easily resume