Skip to content

GitLab

Unverified Commit c3c05b06 authored by James A. Michaelov's avatar James A. Michaelov Committed by GitHub
Browse files

set aggregation and higher_is_better (instead of falling back on defaults) (#2692)

parent 96f5e58f
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
lm_eval/tasks/blimp/_template_yaml
View file @ c3c05b06
...@@ -9,5 +9,7 @@ should_decontaminate: true ...@@ -9,5 +9,7 @@ should_decontaminate: true
doc_to_decontamination_query: "{{sentence_good}} {{sentence_bad}}" doc_to_decontamination_query: "{{sentence_good}} {{sentence_bad}}"
metric_list: metric_list:
- metric: acc - metric: acc
aggregation: mean
higher_is_better: true
metadata: metadata:
version: 1.0 version: 1.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment