Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
e160a9f9
Commit
e160a9f9
authored
Oct 08, 2025
by
Baber
Browse files
add mc tasks
parent
c0fc7172
Changes
99
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
60 additions
and
0 deletions
+60
-0
lm_eval/tasks/mrl/mc/mni_beng.yaml
lm_eval/tasks/mrl/mc/mni_beng.yaml
+3
-0
lm_eval/tasks/mrl/mc/nag_latn.yaml
lm_eval/tasks/mrl/mc/nag_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/nld_latn.yaml
lm_eval/tasks/mrl/mc/nld_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/nno_latn.yaml
lm_eval/tasks/mrl/mc/nno_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/nob_latn.yaml
lm_eval/tasks/mrl/mc/nob_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/npi_deva.yaml
lm_eval/tasks/mrl/mc/npi_deva.yaml
+3
-0
lm_eval/tasks/mrl/mc/pcm_latn.yaml
lm_eval/tasks/mrl/mc/pcm_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/pes_arab.yaml
lm_eval/tasks/mrl/mc/pes_arab.yaml
+3
-0
lm_eval/tasks/mrl/mc/pol_latn.yaml
lm_eval/tasks/mrl/mc/pol_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/por_latn_braz.yaml
lm_eval/tasks/mrl/mc/por_latn_braz.yaml
+3
-0
lm_eval/tasks/mrl/mc/por_latn_port.yaml
lm_eval/tasks/mrl/mc/por_latn_port.yaml
+3
-0
lm_eval/tasks/mrl/mc/ron_latn.yaml
lm_eval/tasks/mrl/mc/ron_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/rwr_deva.yaml
lm_eval/tasks/mrl/mc/rwr_deva.yaml
+3
-0
lm_eval/tasks/mrl/mc/sin_sinh.yaml
lm_eval/tasks/mrl/mc/sin_sinh.yaml
+3
-0
lm_eval/tasks/mrl/mc/slk_latn.yaml
lm_eval/tasks/mrl/mc/slk_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/slk_latn_sari.yaml
lm_eval/tasks/mrl/mc/slk_latn_sari.yaml
+3
-0
lm_eval/tasks/mrl/mc/slv_latn.yaml
lm_eval/tasks/mrl/mc/slv_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/slv_latn_cerk.yaml
lm_eval/tasks/mrl/mc/slv_latn_cerk.yaml
+3
-0
lm_eval/tasks/mrl/mc/snd_arab.yaml
lm_eval/tasks/mrl/mc/snd_arab.yaml
+3
-0
lm_eval/tasks/mrl/mc/snd_deva.yaml
lm_eval/tasks/mrl/mc/snd_deva.yaml
+3
-0
No files found.
lm_eval/tasks/mrl/mc/mni_beng.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_mni_beng
dataset_name
:
mni_beng
lm_eval/tasks/mrl/mc/nag_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_nag_latn
dataset_name
:
nag_latn
lm_eval/tasks/mrl/mc/nld_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_nld_latn
dataset_name
:
nld_latn
lm_eval/tasks/mrl/mc/nno_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_nno_latn
dataset_name
:
nno_latn
lm_eval/tasks/mrl/mc/nob_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_nob_latn
dataset_name
:
nob_latn
lm_eval/tasks/mrl/mc/npi_deva.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_npi_deva
dataset_name
:
npi_deva
lm_eval/tasks/mrl/mc/pcm_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_pcm_latn
dataset_name
:
pcm_latn
lm_eval/tasks/mrl/mc/pes_arab.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_pes_arab
dataset_name
:
pes_arab
lm_eval/tasks/mrl/mc/pol_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_pol_latn
dataset_name
:
pol_latn
lm_eval/tasks/mrl/mc/por_latn_braz.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_por_latn_braz
dataset_name
:
por_latn_braz
lm_eval/tasks/mrl/mc/por_latn_port.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_por_latn_port
dataset_name
:
por_latn_port
lm_eval/tasks/mrl/mc/ron_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ron_latn
dataset_name
:
ron_latn
lm_eval/tasks/mrl/mc/rwr_deva.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_rwr_deva
dataset_name
:
rwr_deva
lm_eval/tasks/mrl/mc/sin_sinh.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_sin_sinh
dataset_name
:
sin_sinh
lm_eval/tasks/mrl/mc/slk_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_slk_latn
dataset_name
:
slk_latn
lm_eval/tasks/mrl/mc/slk_latn_sari.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_slk_latn_sari
dataset_name
:
slk_latn_sari
lm_eval/tasks/mrl/mc/slv_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_slv_latn
dataset_name
:
slv_latn
lm_eval/tasks/mrl/mc/slv_latn_cerk.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_slv_latn_cerk
dataset_name
:
slv_latn_cerk
lm_eval/tasks/mrl/mc/snd_arab.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_snd_arab
dataset_name
:
snd_arab
lm_eval/tasks/mrl/mc/snd_deva.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_snd_deva
dataset_name
:
snd_deva
Prev
1
2
3
4
5
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment