Skip to content

GitLab

Commit c256eda8 authored by h-albert-lee's avatar h-albert-lee
Browse files

Debugging

parent 489814b7
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/kmmlu/utils.py
View file @ c256eda8
...@@ -13,7 +13,7 @@ def process_docs(dataset: datasets.Dataset) -> datasets.Dataset: ...@@ -13,7 +13,7 @@ def process_docs(dataset: datasets.Dataset) -> datasets.Dataset:
out_doc = { out_doc = {
"question": instruction, "question": instruction,
"choices": ["(1)", "(2)", "(3)", "(4)"], "choices": ["(1)", "(2)", "(3)", "(4)"],
"gold": int(doc["gold"]) - 1, "gold": int(doc["answer"]) - 1,
} }
return out_doc return out_doc
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment