Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "0601203a70f2334fc7b72a86377990810c7b7ab7"
Commit cc568ebf authored by Baber's avatar Baber
Browse files

nit

parent d75cbc7a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 3 deletions
lm_eval/tasks/humaneval/utils.py
View file @ cc568ebf
...@@ -20,9 +20,7 @@ def pass_at_1(references: list[str], predictions: list[list[str]], k: list[int] ...@@ -20,9 +20,7 @@ def pass_at_1(references: list[str], predictions: list[list[str]], k: list[int]
k=k, k=k,
)[0] )[0]
return { return res
key: val for key, val in res.items() if key in map(lambda x: f"pass@{x}", k)
}
def build_references(doc): def build_references(doc):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment