Skip to content

GitLab

Commit 18f7dfb3 authored by lintangsutawika's avatar lintangsutawika
Browse files

temp

parent 8c93320a
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
lm_eval/tasks/super_glue/record/t5-prompt.yaml
View file @ 18f7dfb3
...@@ -6,6 +6,7 @@ dataset_name: record ...@@ -6,6 +6,7 @@ dataset_name: record
training_split: train training_split: train
validation_split: validation validation_split: validation
output_type: greedy_until output_type: greedy_until
process_doc: !function t5_utils.process_doc
doc_to_text: "record query: {{query}} entities: {{entities|join(\", \")}} passage: {{passage}}" doc_to_text: "record query: {{query}} entities: {{entities|join(\", \")}} passage: {{passage}}"
doc_to_target: "{{answers}}" doc_to_target: "{{answers}}"
metric_list: metric_list:
......
lm_eval/tasks/super_glue/wsc/t5-prompt.yaml
View file @ 18f7dfb3
...@@ -7,7 +7,7 @@ training_split: train ...@@ -7,7 +7,7 @@ training_split: train
validation_split: validation validation_split: validation
output_type: greedy_until output_type: greedy_until
doc_to_text: !function "t5_utils.t5_prompt_doc_to_text" doc_to_text: !function "t5_utils.t5_prompt_doc_to_text"
doc_to_target: span1_text doc_to_target: "{{[span1_text, span2_text][label]}}"
metric_list: metric_list:
- metric: exact_match - metric: exact_match
aggregation: mean aggregation: mean
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment