Skip to content

GitLab

"cacheflow/vscode:/vscode.git/clone" did not exist on "56b7f0efa4d83865afc2da38b40b2f337d778dda"
Commit 2078adba authored by Leo Gao's avatar Leo Gao
Browse files

Make CoQA take the first line of output excluding any leading whitespace

parent cc474a94
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/coqa.py
View file @ 2078adba
...@@ -115,7 +115,7 @@ class CoQA(Task): ...@@ -115,7 +115,7 @@ class CoQA(Task):
language description, as well as the few shot examples, and the question language description, as well as the few shot examples, and the question
part of the document for `doc`. part of the document for `doc`.
""" """
cont_request = rf.greedy_until(ctx, ['\nQ:']) cont_request = rf.greedy_until(ctx, ['\nQ:']).strip().split('\n')[0]
return cont_request return cont_request
def process_results(self, doc, results): def process_results(self, doc, results):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment