Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
e160a9f9
Commit
e160a9f9
authored
Oct 08, 2025
by
Baber
Browse files
add mc tasks
parent
c0fc7172
Changes
99
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
60 additions
and
0 deletions
+60
-0
lm_eval/tasks/mrl/mc/bho_deva.yaml
lm_eval/tasks/mrl/mc/bho_deva.yaml
+3
-0
lm_eval/tasks/mrl/mc/bsk_arab.yaml
lm_eval/tasks/mrl/mc/bsk_arab.yaml
+3
-0
lm_eval/tasks/mrl/mc/bul_cyrl.yaml
lm_eval/tasks/mrl/mc/bul_cyrl.yaml
+3
-0
lm_eval/tasks/mrl/mc/cat_latn.yaml
lm_eval/tasks/mrl/mc/cat_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/ces_latn.yaml
lm_eval/tasks/mrl/mc/ces_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/ckb_arab.yaml
lm_eval/tasks/mrl/mc/ckb_arab.yaml
+3
-0
lm_eval/tasks/mrl/mc/ckm_latn.yaml
lm_eval/tasks/mrl/mc/ckm_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/cmn_hans.yaml
lm_eval/tasks/mrl/mc/cmn_hans.yaml
+3
-0
lm_eval/tasks/mrl/mc/cmn_hant.yaml
lm_eval/tasks/mrl/mc/cmn_hant.yaml
+3
-0
lm_eval/tasks/mrl/mc/dhd_deva.yaml
lm_eval/tasks/mrl/mc/dhd_deva.yaml
+3
-0
lm_eval/tasks/mrl/mc/ell_grek.yaml
lm_eval/tasks/mrl/mc/ell_grek.yaml
+3
-0
lm_eval/tasks/mrl/mc/eng_latn.yaml
lm_eval/tasks/mrl/mc/eng_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/est_latn.yaml
lm_eval/tasks/mrl/mc/est_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/fao_latn.yaml
lm_eval/tasks/mrl/mc/fao_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/fin_latn.yaml
lm_eval/tasks/mrl/mc/fin_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/fra_latn_cana.yaml
lm_eval/tasks/mrl/mc/fra_latn_cana.yaml
+3
-0
lm_eval/tasks/mrl/mc/fra_latn_fran.yaml
lm_eval/tasks/mrl/mc/fra_latn_fran.yaml
+3
-0
lm_eval/tasks/mrl/mc/glg_latn.yaml
lm_eval/tasks/mrl/mc/glg_latn.yaml
+3
-0
lm_eval/tasks/mrl/mc/guj_gujr.yaml
lm_eval/tasks/mrl/mc/guj_gujr.yaml
+3
-0
lm_eval/tasks/mrl/mc/hau_latn.yaml
lm_eval/tasks/mrl/mc/hau_latn.yaml
+3
-0
No files found.
lm_eval/tasks/mrl/mc/bho_deva.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_bho_deva
dataset_name
:
bho_deva
lm_eval/tasks/mrl/mc/bsk_arab.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_bsk_arab
dataset_name
:
bsk_arab
lm_eval/tasks/mrl/mc/bul_cyrl.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_bul_cyrl
dataset_name
:
bul_cyrl
lm_eval/tasks/mrl/mc/cat_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_cat_latn
dataset_name
:
cat_latn
lm_eval/tasks/mrl/mc/ces_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ces_latn
dataset_name
:
ces_latn
lm_eval/tasks/mrl/mc/ckb_arab.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ckb_arab
dataset_name
:
ckb_arab
lm_eval/tasks/mrl/mc/ckm_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ckm_latn
dataset_name
:
ckm_latn
lm_eval/tasks/mrl/mc/cmn_hans.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_cmn_hans
dataset_name
:
cmn_hans
lm_eval/tasks/mrl/mc/cmn_hant.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_cmn_hant
dataset_name
:
cmn_hant
lm_eval/tasks/mrl/mc/dhd_deva.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_dhd_deva
dataset_name
:
dhd_deva
lm_eval/tasks/mrl/mc/ell_grek.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_ell_grek
dataset_name
:
ell_grek
lm_eval/tasks/mrl/mc/eng_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_eng_latn
dataset_name
:
eng_latn
lm_eval/tasks/mrl/mc/est_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_est_latn
dataset_name
:
est_latn
lm_eval/tasks/mrl/mc/fao_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_fao_latn
dataset_name
:
fao_latn
lm_eval/tasks/mrl/mc/fin_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_fin_latn
dataset_name
:
fin_latn
lm_eval/tasks/mrl/mc/fra_latn_cana.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_fra_latn_cana
dataset_name
:
fra_latn_cana
lm_eval/tasks/mrl/mc/fra_latn_fran.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_fra_latn_fran
dataset_name
:
fra_latn_fran
lm_eval/tasks/mrl/mc/glg_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_glg_latn
dataset_name
:
glg_latn
lm_eval/tasks/mrl/mc/guj_gujr.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_guj_gujr
dataset_name
:
guj_gujr
lm_eval/tasks/mrl/mc/hau_latn.yaml
0 → 100644
View file @
e160a9f9
include
:
'
_template_mc'
task
:
mrl_hau_latn
dataset_name
:
hau_latn
Prev
1
2
3
4
5
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment