Skip to content

GitLab

"tests/vscode:/vscode.git/clone" did not exist on "fce2a1863ed22032a9c552865a72abd2e22d64d8"
Unverified Commit caadcbc9 authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

Update babi.py

parent 9a29afbb
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/babi.py
View file @ caadcbc9
...@@ -51,7 +51,7 @@ class Babi(Task): ...@@ -51,7 +51,7 @@ class Babi(Task):
return False # TODO Necessary? return False # TODO Necessary?
def doc_to_decontamination_query(self, doc): def doc_to_decontamination_query(self, doc):
return doc['passage'] + doc['question'] return f"Passage: {doc['passage']}\nQuestion: {doc['question']}\nAnswer:"
def doc_to_target(self, doc): def doc_to_target(self, doc):
return " " + doc['answer'] return " " + doc['answer']
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment