Skip to content

GitLab

Commit 0bde7589 authored by thomasw21's avatar thomasw21
Browse files

Revert "Add capital letters" 

This reverts commit 23a42067.
parent 23a42067
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/superglue.py
View file @ 0bde7589
...@@ -227,7 +227,7 @@ class MultiRC(HFTask): ...@@ -227,7 +227,7 @@ class MultiRC(HFTask):
@staticmethod @staticmethod
def format_answer(answer, label): def format_answer(answer, label):
label_str = "Yes" if label else "No" label_str = "yes" if label else "no"
return f"{answer}\nIs the answer correct? {label_str}" return f"{answer}\nIs the answer correct? {label_str}"
def construct_requests(self, doc, ctx): def construct_requests(self, doc, ctx):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment