Fix LR scheduler based on bs from auto bs finder (#24521)

* One solution * args -> self

Fix LR scheduler based on bs from auto bs finder (#24521)
* One solution * args -> self
fb6a6276 · Zach Mueller · GitHub · 38db04ec · fb6a6276
Unverified Commit fb6a6276 authored Jun 27, 2023 by Zach Mueller Committed by GitHub Jun 27, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

src/transformers/trainer.py src/transformers/trainer.py +1 -1

No files found.
--- a/src/transformers/trainer.py
+++ b/src/transformers/trainer.py
@@ -1553,7 +1553,7 @@ class Trainer:
        # number of training epochs: num_train_epochs
        # number of training steps per epoch: num_update_steps_per_epoch
        # total number of training steps to execute: max_steps
-        total_train_batch_size = args.train_batch_size * args.gradient_accumulation_steps * args.world_size
+        total_train_batch_size = self._train_batch_size * args.gradient_accumulation_steps * args.world_size

        len_dataloader = None
        if has_length(train_dataloader):