Skip to content

GitLab

You need to sign in or sign up before continuing.
Commit 33b01a2b authored by lintangsutawika's avatar lintangsutawika
Browse files

metric list easier to define args

parent f107ae29
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 7 deletions
examples/configurable_task/sglue_cb.yaml
View file @ 33b01a2b
...@@ -5,10 +5,9 @@ validation_split: validation ...@@ -5,10 +5,9 @@ validation_split: validation
template_aliases: "{% set hypo = hypothesis %}" template_aliases: "{% set hypo = hypothesis %}"
doc_to_text: "Suppose {{premise}} Can we infer that \"{{hypo}}\"? Yes, no, or maybe?" doc_to_text: "Suppose {{premise}} Can we infer that \"{{hypo}}\"? Yes, no, or maybe?"
doc_to_target: "{% set answer_choices = ['Yes', 'No', 'Maybe'] %}{{answer_choices[label]}}" doc_to_target: "{% set answer_choices = ['Yes', 'No', 'Maybe'] %}{{answer_choices[label]}}"
metric_list: [ metric_list:
[exact_match, mean, true] - metric: exact_match
] aggregation: mean
# filters: [ higher_is_better: true
# ["none", ["take_first"]] ignore_case: true
# ] ignore_punctuation: true
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment