Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
ab96fc7e
Commit
ab96fc7e
authored
Feb 20, 2024
by
lintangsutawika
Browse files
merged with latest update
parents
bf2517cc
8680e938
Changes
128
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml
+4
-0
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml
+4
-0
No files found.
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
hi
include
:
_default_yaml
task
:
m_mmlu_hi
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
hr
include
:
_default_yaml
task
:
m_mmlu_hr
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
hu
include
:
_default_yaml
task
:
m_mmlu_hu
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
id
include
:
_default_yaml
task
:
m_mmlu_id
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
is
include
:
_default_yaml
task
:
m_mmlu_is
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
it
include
:
_default_yaml
task
:
m_mmlu_it
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
kn
include
:
_default_yaml
task
:
m_mmlu_kn
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
ml
include
:
_default_yaml
task
:
m_mmlu_ml
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
mr
include
:
_default_yaml
task
:
m_mmlu_mr
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
nb
include
:
_default_yaml
task
:
m_mmlu_nb
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
ne
include
:
_default_yaml
task
:
m_mmlu_ne
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
nl
include
:
_default_yaml
task
:
m_mmlu_nl
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
pt
include
:
_default_yaml
task
:
m_mmlu_pt
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
ro
include
:
_default_yaml
task
:
m_mmlu_ro
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
ru
include
:
_default_yaml
task
:
m_mmlu_ru
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
sr
include
:
_default_yaml
task
:
m_mmlu_sr
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
sv
include
:
_default_yaml
task
:
m_mmlu_sv
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
ta
include
:
_default_yaml
task
:
m_mmlu_ta
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
te
include
:
_default_yaml
task
:
m_mmlu_te
lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml
0 → 100644
View file @
ab96fc7e
# Generated by _generate_configs.py
dataset_name
:
uk
include
:
_default_yaml
task
:
m_mmlu_uk
Prev
1
2
3
4
5
6
7
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment