fix executable batch size issue (#24067)

* fix executable batch size issue * fix * undo

fix executable batch size issue (#24067)
* fix executable batch size issue * fix * undo
12298cb6 · Sourab Mangrulkar · GitHub · ef010071 · 12298cb6
Unverified Commit 12298cb6 authored Jun 07, 2023 by Sourab Mangrulkar Committed by GitHub Jun 07, 2023
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

src/transformers/trainer.py src/transformers/trainer.py +1 -0

No files found.
--- a/src/transformers/trainer.py
+++ b/src/transformers/trainer.py
@@ -1650,6 +1650,7 @@ class Trainer:
    def _inner_training_loop(
        self, batch_size=None, args=None, resume_from_checkpoint=None, trial=None, ignore_keys_for_eval=None
    ):
+        self.accelerator.free_memory()
        self._train_batch_size = batch_size
        logger.debug(f"Currently training with a batch size of: {self._train_batch_size}")
        # Data loader and number of training steps