Fix `KerasMetricCallback`: pass `generate_kwargs` even if `use_xla_generation` is False (#24333)

* Fix `KerasMetricCallback`: always pass `generate_kwargs`. * Reformat code using Black.

Fix `KerasMetricCallback`: pass `generate_kwargs` even if `use_xla_generation` is False (#24333)
* Fix `KerasMetricCallback`: always pass `generate_kwargs`. * Reformat code using Black.
3b5a56e5 · Matěj Kripner · GitHub · 0b259a3b · 3b5a56e5
Unverified Commit 3b5a56e5 authored Jun 19, 2023 by Matěj Kripner Committed by GitHub Jun 19, 2023
Show whitespace changes
Inline Side-by-side

Showing with 3 additions and 1 deletion

src/transformers/keras_callbacks.py src/transformers/keras_callbacks.py +3 -1

No files found.
--- a/src/transformers/keras_callbacks.py
+++ b/src/transformers/keras_callbacks.py
@@ -224,7 +224,9 @@ class KerasMetricCallback(Callback):
                if self.use_xla_generation:
                    predictions = self.generation_function(generation_inputs, attention_mask=attention_mask)
                else:
-                    predictions = self.model.generate(generation_inputs, attention_mask=attention_mask)
+                    predictions = self.model.generate(
+                        generation_inputs, attention_mask=attention_mask, **self.generate_kwargs
+                    )
            else:
                predictions = self.model.predict_on_batch(batch)
                if isinstance(predictions, dict):