Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
e160a9f9
Commit
e160a9f9
authored
Oct 08, 2025
by
Baber
Browse files
add mc tasks
parent
c0fc7172
Changes
99
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
60 additions
and
0 deletions
+60
-0
lm_eval/tasks/mrl/mc/haw_latn.yaml
lm_eval/tasks/mrl/mc/haw_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/heb_hebr.yaml
lm_eval/tasks/mrl/mc/heb_hebr.yaml
+3
-0
lm_eval/tasks/mrl/mc/hrv_latn.yaml
lm_eval/tasks/mrl/mc/hrv_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/hun_latn.yaml
lm_eval/tasks/mrl/mc/hun_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/hye_armn.yaml
lm_eval/tasks/mrl/mc/hye_armn.yaml
+3
-0
lm_eval/tasks/mrl/mc/ibo_latn.yaml
lm_eval/tasks/mrl/mc/ibo_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/idu_latn.yaml
lm_eval/tasks/mrl/mc/idu_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/ind_latn.yaml
lm_eval/tasks/mrl/mc/ind_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/isl_latn.yaml
lm_eval/tasks/mrl/mc/isl_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/iso_latn.yaml
lm_eval/tasks/mrl/mc/iso_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/ita_latn.yaml
lm_eval/tasks/mrl/mc/ita_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/jav_latn.yaml
lm_eval/tasks/mrl/mc/jav_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/jpn_jpan.yaml
lm_eval/tasks/mrl/mc/jpn_jpan.yaml
+3
-0
lm_eval/tasks/mrl/mc/kat_geor.yaml
lm_eval/tasks/mrl/mc/kat_geor.yaml
+3
-0
lm_eval/tasks/mrl/mc/kaz_cyrl.yaml
lm_eval/tasks/mrl/mc/kaz_cyrl.yaml
+3
-0
lm_eval/tasks/mrl/mc/kir_cyrl.yaml
lm_eval/tasks/mrl/mc/kir_cyrl.yaml
+3
-0
lm_eval/tasks/mrl/mc/kor_hang.yaml
lm_eval/tasks/mrl/mc/kor_hang.yaml
+3
-0
lm_eval/tasks/mrl/mc/lit_latn.yaml
lm_eval/tasks/mrl/mc/lit_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/mar_deva.yaml
lm_eval/tasks/mrl/mc/mar_deva.yaml
+3
-0
lm_eval/tasks/mrl/mc/mkd_cyrl.yaml
lm_eval/tasks/mrl/mc/mkd_cyrl.yaml
+3
-0
No files found.
lm_eval/tasks/mrl/mc/haw_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_haw_latn
dataset_name
:
haw_latn
lm_eval/tasks/mrl/mc/heb_hebr.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_heb_hebr
dataset_name
:
heb_hebr
lm_eval/tasks/mrl/mc/hrv_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_hrv_latn
dataset_name
:
hrv_latn
lm_eval/tasks/mrl/mc/hun_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_hun_latn
dataset_name
:
hun_latn
lm_eval/tasks/mrl/mc/hye_armn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_hye_armn
dataset_name
:
hye_armn
lm_eval/tasks/mrl/mc/ibo_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ibo_latn
dataset_name
:
ibo_latn
lm_eval/tasks/mrl/mc/idu_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_idu_latn
dataset_name
:
idu_latn
lm_eval/tasks/mrl/mc/ind_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ind_latn
dataset_name
:
ind_latn
lm_eval/tasks/mrl/mc/isl_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_isl_latn
dataset_name
:
isl_latn
lm_eval/tasks/mrl/mc/iso_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_iso_latn
dataset_name
:
iso_latn
lm_eval/tasks/mrl/mc/ita_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ita_latn
dataset_name
:
ita_latn
lm_eval/tasks/mrl/mc/jav_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_jav_latn
dataset_name
:
jav_latn
lm_eval/tasks/mrl/mc/jpn_jpan.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_jpn_jpan
dataset_name
:
jpn_jpan
lm_eval/tasks/mrl/mc/kat_geor.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_kat_geor
dataset_name
:
kat_geor
lm_eval/tasks/mrl/mc/kaz_cyrl.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_kaz_cyrl
dataset_name
:
kaz_cyrl
lm_eval/tasks/mrl/mc/kir_cyrl.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_kir_cyrl
dataset_name
:
kir_cyrl
lm_eval/tasks/mrl/mc/kor_hang.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_kor_hang
dataset_name
:
kor_hang
lm_eval/tasks/mrl/mc/lit_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_lit_latn
dataset_name
:
lit_latn
lm_eval/tasks/mrl/mc/mar_deva.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_mar_deva
dataset_name
:
mar_deva
lm_eval/tasks/mrl/mc/mkd_cyrl.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_mkd_cyrl
dataset_name
:
mkd_cyrl
Prev
1
2
3
4
5
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment