Update huggingface.py

`max_length` was misdefined as a tuple.

Update huggingface.py
`max_length` was misdefined as a tuple.
f40c434e · Lintang Sutawika · GitHub · 176d5a26 · f40c434e
Unverified Commit f40c434e authored Aug 03, 2023 by Lintang Sutawika Committed by GitHub Aug 03, 2023
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

lm_eval/models/huggingface.py lm_eval/models/huggingface.py +1 -1

No files found.
--- a/lm_eval/models/huggingface.py
+++ b/lm_eval/models/huggingface.py
@@ -758,7 +758,7 @@ class HFLM(LM):
                attn_masks = attn_masks.to(self.device)

                if "max_length" not in kwargs:
-                    kwargs["max_length"] = (context_enc.shape[1] + max_gen_toks,)
+                    kwargs["max_length"] = context_enc.shape[1] + max_gen_toks

                # perform batched generation
                cont = self._model_generate(