Skip to content

GitLab

"tests/git@developer.sourcefind.cn:modelzoo/qwen_lmdeploy.git" did not exist on "fe46dac2c2ea1a988929fba05e9d3d3c9b11dfd7"
Unverified Commit 032e879b authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

Update nq_open.yaml (#1289)

parent 588a493c
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
lm_eval/tasks/nq_open/nq_open.yaml
View file @ 032e879b
...@@ -3,7 +3,7 @@ dataset_path: nq_open ...@@ -3,7 +3,7 @@ dataset_path: nq_open
output_type: generate_until output_type: generate_until
training_split: train training_split: train
validation_split: validation validation_split: validation
description: "Answer these questions:\n" description: "Answer these questions:\n\n"
doc_to_text: "Q: {{question}}?\nA:" doc_to_text: "Q: {{question}}?\nA:"
doc_to_target: "{{answer}}" # TODO: should be multi-target doc_to_target: "{{answer}}" # TODO: should be multi-target
fewshot_delimiter: "\n" fewshot_delimiter: "\n"
...@@ -29,4 +29,4 @@ metric_list: ...@@ -29,4 +29,4 @@ metric_list:
regexes_to_ignore: regexes_to_ignore:
- "\ban|a|the\b" - "\ban|a|the\b"
metadata: metadata:
version: 1.0 version: 2.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment