Skip to content

GitLab

Unverified Commit 267867e8 authored by Matt's avatar Matt Committed by GitHub
Browse files

Quick fix to TF summarization example (#14401)

parent 29dfb2db
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/tensorflow/summarization/run_summarization.py
View file @ 267867e8
...@@ -577,7 +577,7 @@ def main(): ...@@ -577,7 +577,7 @@ def main():
# region Optimizer, loss and LR scheduling # region Optimizer, loss and LR scheduling
# Scheduler and math around the number of training steps. # Scheduler and math around the number of training steps.
num_update_steps_per_epoch = len(train_dataset) // training_args.per_device_train_batch_size num_update_steps_per_epoch = len(train_dataset) // total_train_batch_size
num_train_steps = training_args.num_train_epochs * num_update_steps_per_epoch num_train_steps = training_args.num_train_epochs * num_update_steps_per_epoch
optimizer, lr_schedule = create_optimizer( optimizer, lr_schedule = create_optimizer(
init_lr=training_args.learning_rate, num_train_steps=num_train_steps, num_warmup_steps=0 init_lr=training_args.learning_rate, num_train_steps=num_train_steps, num_warmup_steps=0
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment