Skip to content

GitLab

Unverified Commit 5c006ed4 authored by Minho Ryu's avatar Minho Ryu Committed by GitHub
Browse files

separate category for `global_mmlu` (#2652) 

* separate category

* set version 0.0

* apply precommit
parent 370e2f9e
Hide whitespace changes
Inline Side-by-side
Showing with 13 additions and 13 deletions
lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment