Skip to content

GitLab

Commit f7a0235d authored by lintangsutawika's avatar lintangsutawika
Browse files

update yaml

parent d4e075e3
Show whitespace changes
Inline Side-by-side
Showing with 7 additions and 4 deletions
lm_eval/tasks/super_glue/multirc/t5-prompt.yaml
View file @ f7a0235d
...@@ -9,9 +9,12 @@ output_type: greedy_until ...@@ -9,9 +9,12 @@ output_type: greedy_until
doc_to_text: "multirc question: {{question}} answer: {{answer}} paragraph: {{paragraph}}" doc_to_text: "multirc question: {{question}} answer: {{answer}} paragraph: {{paragraph}}"
doc_to_target: label doc_to_target: label
doc_to_choice: ['False', 'True'] doc_to_choice: ['False', 'True']
generation_kwargs:
until:
- "</s>"
do_sample: false
temperature: 0.5
metric_list: metric_list:
- metric: exact_match - metric: !function t5_utils.f1
aggregation: mean aggregation: !function t5_utils.agg_f1
higher_is_better: true higher_is_better: true
ignore_case: true
ignore_punctuation: true
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment