Skip to content

GitLab

Commit 691b4ca9 authored by lintangsutawika's avatar lintangsutawika
Browse files

temp

parent 18f7dfb3
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
lm_eval/tasks/super_glue/record/t5-prompt.yaml
View file @ 691b4ca9
...@@ -6,8 +6,8 @@ dataset_name: record ...@@ -6,8 +6,8 @@ dataset_name: record
training_split: train training_split: train
validation_split: validation validation_split: validation
output_type: greedy_until output_type: greedy_until
process_doc: !function t5_utils.process_doc process_docs: !function t5_utils.process_docs
doc_to_text: "record query: {{query}} entities: {{entities|join(\", \")}} passage: {{passage}}" doc_to_text: !function t5_utils.doc_to_text
doc_to_target: "{{answers}}" doc_to_target: "{{answers}}"
metric_list: metric_list:
- metric: exact_match - metric: exact_match
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment