Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
032e879b
Unverified
Commit
032e879b
authored
Jan 15, 2024
by
Hailey Schoelkopf
Committed by
GitHub
Jan 16, 2024
Browse files
Update nq_open.yaml (#1289)
parent
588a493c
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
lm_eval/tasks/nq_open/nq_open.yaml
lm_eval/tasks/nq_open/nq_open.yaml
+2
-2
No files found.
lm_eval/tasks/nq_open/nq_open.yaml
View file @
032e879b
...
...
@@ -3,7 +3,7 @@ dataset_path: nq_open
output_type
:
generate_until
training_split
:
train
validation_split
:
validation
description
:
"
Answer
these
questions:
\n
"
description
:
"
Answer
these
questions:
\n
\n
"
doc_to_text
:
"
Q:
{{question}}?
\n
A:"
doc_to_target
:
"
{{answer}}"
# TODO: should be multi-target
fewshot_delimiter
:
"
\n
"
...
...
@@ -29,4 +29,4 @@ metric_list:
regexes_to_ignore
:
-
"
\b
an|a|the
\b
"
metadata
:
version
:
1
.0
version
:
2
.0
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment