Skip to content

GitLab

Unverified Commit 5c006ed4 authored by Minho Ryu's avatar Minho Ryu Committed by GitHub
Browse files

separate category for `global_mmlu` (#2652) 

* separate category

* set version 0.0

* apply precommit
parent 370e2f9e
Hide whitespace changes
Inline Side-by-side
Showing with 20 additions and 20 deletions
lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml
View file @ 5c006ed4
......@@ -8,4 +8,4 @@ aggregate_metric_list:
- metric: acc
weight_by_size: True
metadata:
version: 1.0
version: 0.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment