log arguments too

fb108f2e · haileyschoelkopf · 9dea125b · fb108f2e
Commit fb108f2e authored Jun 28, 2023 by haileyschoelkopf
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

lm_eval/evaluator.py lm_eval/evaluator.py +1 -0

No files found.
--- a/lm_eval/evaluator.py
+++ b/lm_eval/evaluator.py
@@ -277,6 +277,7 @@ def evaluate(
                    "doc_id": doc_id,
                    "doc": doc,
                    "target": target,
+                    "arguments": req.args,
                    "resps": [req.resps for req in requests],
                    "filtered_resps": [req.filtered_resps[key] for req in requests],
                }