Skip to content

GitLab

Commit 33b01a2b authored by lintangsutawika's avatar lintangsutawika
Browse files

metric list easier to define args

parent f107ae29
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 7 deletions
examples/configurable_task/sglue_cb.yaml
View file @ 33b01a2b
...@@ -5,10 +5,9 @@ validation_split: validation ...@@ -5,10 +5,9 @@ validation_split: validation
template_aliases: "{% set hypo = hypothesis %}" template_aliases: "{% set hypo = hypothesis %}"
doc_to_text: "Suppose {{premise}} Can we infer that \"{{hypo}}\"? Yes, no, or maybe?" doc_to_text: "Suppose {{premise}} Can we infer that \"{{hypo}}\"? Yes, no, or maybe?"
doc_to_target: "{% set answer_choices = ['Yes', 'No', 'Maybe'] %}{{answer_choices[label]}}" doc_to_target: "{% set answer_choices = ['Yes', 'No', 'Maybe'] %}{{answer_choices[label]}}"
metric_list: [ metric_list:
[exact_match, mean, true] - metric: exact_match
] aggregation: mean
# filters: [ higher_is_better: true
# ["none", ["take_first"]] ignore_case: true
# ] ignore_punctuation: true
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment