Skip to content

GitLab

Commit 4dd69062 authored by lintangsutawika's avatar lintangsutawika
Browse files

adjust mmlu to use group_config

parent eb9c6a57
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
lm_eval/tasks/mmlu/default/_mmlu.yaml
View file @ 4dd69062
...@@ -6,5 +6,4 @@ task: ...@@ -6,5 +6,4 @@ task:
- mmlu_humanities - mmlu_humanities
group_config: group_config:
aggregate_metric: True aggregate_metric: True
aggregate_fn: mean
weight_by_size: True weight_by_size: True
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment