Muellerzr fix deepspeed (#23657)

* Fix deepspeed recursion * Better fix

Muellerzr fix deepspeed (#23657)
* Fix deepspeed recursion * Better fix
fe34486f · Zachary Mueller · GitHub · 7bbdfd7b · fe34486f
Unverified Commit fe34486f authored May 22, 2023 by Zachary Mueller Committed by GitHub May 22, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 1 deletion

src/transformers/training_args.py src/transformers/training_args.py +2 -1

No files found.
--- a/src/transformers/training_args.py
+++ b/src/transformers/training_args.py
@@ -1708,7 +1708,8 @@ class TrainingArguments:
        """
        requires_backends(self, ["torch"])
        # Make sure `self._n_gpu` is properly setup.
-        _ = self._setup_devices
+        if not hasattr(self, "_n_gpu"):
+            _ = self._setup_devices
        return self._n_gpu

    @property