Skip to content

GitLab

Commit 1960eb9a authored by lintangsutawika's avatar lintangsutawika
Browse files

new mmlu config

parent 0ffdee02
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 7 deletions
lm_eval/tasks/mmlu/default/_mmlu.yaml
View file @ 1960eb9a
...@@ -18,13 +18,12 @@ task: ...@@ -18,13 +18,12 @@ task:
aggregate_metric: True aggregate_metric: True
weight_by_size: True weight_by_size: True
tag_to_task: True tag_to_task: True
- hum - group: humanities
# - group: humanities task:
# task: - mmlu_humanities
# - mmlu_humanities aggregate_metric: True
# aggregate_metric: True weight_by_size: True
# weight_by_size: True tag_to_task: True
# tag_to_task: True
aggregate_metric: True aggregate_metric: True
weight_by_size: True weight_by_size: True
version: 1 version: 1
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment