Fix loss computation in Trainer (#13760)

Co-authored-by: quantitative-technologies <james.hirschorn@quantitative-technologies.com>
Co-authored-by: quantitative-technologies <james.hirschorn@quantitative-technologies.com>

src/transformers/trainer.py

@@ -1313,7 +1313,7 @@ class Trainer:
 
                 if args.logging_nan_inf_filter and (torch.isnan(tr_loss_step) or torch.isinf(tr_loss_step)):
                     # if loss is nan or inf simply add the average of previous logged losses
-                    tr_loss += tr_loss / 1 + (self.state.global_step - self._globalstep_last_logged)
+                    tr_loss += tr_loss / (1 + self.state.global_step - self._globalstep_last_logged)
                 else:
                     tr_loss += tr_loss_step