Skip to content

GitLab

Unverified Commit cc474a94 authored by sdtblck's avatar sdtblck Committed by GitHub
Browse files

Change generate until sequence in coqa to be \nQ:

parent 9b9d8dd7
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/coqa.py
View file @ cc474a94
...@@ -115,7 +115,7 @@ class CoQA(Task): ...@@ -115,7 +115,7 @@ class CoQA(Task):
language description, as well as the few shot examples, and the question language description, as well as the few shot examples, and the question
part of the document for `doc`. part of the document for `doc`.
""" """
cont_request = rf.greedy_until(ctx, ['\n']) cont_request = rf.greedy_until(ctx, ['\nQ:'])
return cont_request return cont_request
def process_results(self, doc, results): def process_results(self, doc, results):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment