llama test

39a11d02 · daniel-furman · 43dee065 · 39a11d02
Commit 39a11d02 authored Jan 12, 2024 by daniel-furman
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

lm_eval/models/huggingface.py lm_eval/models/huggingface.py +1 -1

No files found.
--- a/lm_eval/models/huggingface.py
+++ b/lm_eval/models/huggingface.py
@@ -710,7 +710,7 @@ class HFLM(LM):
                tokenize=False,
                add_generation_prompt=True,
            )
-            req.args = (context, req.args[1]) 
+            req.args = (context, req.args[1].strip()) 
            new_reqs.append(req)
        return new_reqs