Unverified Commit 656e17f6 authored by Phuc Van Phan's avatar Phuc Van Phan Committed by GitHub
Browse files

correct resume training steps number in progress bar (#25691)

feat: correct update resume update with steps
parent 6add3b31
......@@ -598,8 +598,8 @@ def main():
# need to multiply `gradient_accumulation_steps` to reflect real steps
resume_step = int(training_difference.replace("step_", "")) * args.gradient_accumulation_steps
starting_epoch = resume_step // len(train_dataloader)
resume_step -= starting_epoch * len(train_dataloader)
completed_steps = resume_step // args.gradient_accumulation_steps
resume_step -= starting_epoch * len(train_dataloader)
# update the progress_bar if load from checkpoint
progress_bar.update(completed_steps)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment