Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "1044d0fb3c1e38812598ac620844bc291db6675e"
Commit 72f5a5df authored by Baber's avatar Baber
Browse files

nit

parent c23161f9
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
lm_eval/evaluator.py
View file @ 72f5a5df
...@@ -655,7 +655,9 @@ def evaluate( ...@@ -655,7 +655,9 @@ def evaluate(
ensure_ascii=False, ensure_ascii=False,
) )
), ),
"prompt_hash": hash_string(requests[0].arguments[0]), "prompt_hash": hash_string(
requests[0].arguments.prompt
),
"target_hash": hash_string(str(target)), "target_hash": hash_string(str(target)),
} }
task_output.logged_samples.append(example) task_output.logged_samples.append(example)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment