Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
5b7ef05f
Commit
5b7ef05f
authored
Oct 14, 2025
by
Baber
Browse files
update mrl subsets
parent
2e8aa9c2
Changes
119
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
lm_eval/tasks/mrl/gen/bam_latn.yaml
lm_eval/tasks/mrl/gen/bam_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/bel_cyrl.yaml
lm_eval/tasks/mrl/gen/bel_cyrl.yaml
+1
-1
lm_eval/tasks/mrl/gen/ben_beng.yaml
lm_eval/tasks/mrl/gen/ben_beng.yaml
+1
-1
lm_eval/tasks/mrl/gen/ben_latn.yaml
lm_eval/tasks/mrl/gen/ben_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/bho_deva.yaml
lm_eval/tasks/mrl/gen/bho_deva.yaml
+1
-1
lm_eval/tasks/mrl/gen/bos_latn.yaml
lm_eval/tasks/mrl/gen/bos_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/bsk_arab.yaml
lm_eval/tasks/mrl/gen/bsk_arab.yaml
+1
-1
lm_eval/tasks/mrl/gen/bul_cyrl.yaml
lm_eval/tasks/mrl/gen/bul_cyrl.yaml
+1
-1
lm_eval/tasks/mrl/gen/cat_latn.yaml
lm_eval/tasks/mrl/gen/cat_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/ces_latn.yaml
lm_eval/tasks/mrl/gen/ces_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/ckb_arab.yaml
lm_eval/tasks/mrl/gen/ckb_arab.yaml
+1
-1
lm_eval/tasks/mrl/gen/ckm_latn.yaml
lm_eval/tasks/mrl/gen/ckm_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/cmn_hans.yaml
lm_eval/tasks/mrl/gen/cmn_hans.yaml
+1
-1
lm_eval/tasks/mrl/gen/cmn_hant.yaml
lm_eval/tasks/mrl/gen/cmn_hant.yaml
+1
-1
lm_eval/tasks/mrl/gen/deu_latn.yaml
lm_eval/tasks/mrl/gen/deu_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/dhd_deva.yaml
lm_eval/tasks/mrl/gen/dhd_deva.yaml
+1
-1
lm_eval/tasks/mrl/gen/ekp_latn.yaml
lm_eval/tasks/mrl/gen/ekp_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/ell_grek.yaml
lm_eval/tasks/mrl/gen/ell_grek.yaml
+1
-1
lm_eval/tasks/mrl/gen/eng_latn.yaml
lm_eval/tasks/mrl/gen/eng_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/est_latn.yaml
lm_eval/tasks/mrl/gen/est_latn.yaml
+1
-1
No files found.
lm_eval/tasks/mrl/gen/bam_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
bam_latn
task
:
bam_latn
dataset_name
:
bam_latn
lm_eval/tasks/mrl/gen/bel_cyrl.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
bel_cyrl
task
:
bel_cyrl
dataset_name
:
bel_cyrl
lm_eval/tasks/mrl/gen/ben_beng.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ben_beng
task
:
ben_beng
dataset_name
:
ben_beng
lm_eval/tasks/mrl/gen/ben_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ben_latn
task
:
ben_latn
dataset_name
:
ben_latn
lm_eval/tasks/mrl/gen/bho_deva.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
bho_deva
task
:
bho_deva
dataset_name
:
bho_deva
lm_eval/tasks/mrl/gen/bos_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
bos_latn
task
:
bos_latn
dataset_name
:
bos_latn
lm_eval/tasks/mrl/gen/bsk_arab.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
bsk_arab
task
:
bsk_arab
dataset_name
:
bsk_arab
lm_eval/tasks/mrl/gen/bul_cyrl.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
bul_cyrl
task
:
bul_cyrl
dataset_name
:
bul_cyrl
lm_eval/tasks/mrl/gen/cat_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
cat_latn
task
:
cat_latn
dataset_name
:
cat_latn
lm_eval/tasks/mrl/gen/ces_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ces_latn
task
:
ces_latn
dataset_name
:
ces_latn
lm_eval/tasks/mrl/gen/ckb_arab.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ckb_arab
task
:
ckb_arab
dataset_name
:
ckb_arab
lm_eval/tasks/mrl/gen/ckm_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ckm_latn
task
:
ckm_latn
dataset_name
:
ckm_latn
lm_eval/tasks/mrl/gen/cmn_hans.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
cmn_hans
task
:
cmn_hans
dataset_name
:
cmn_hans
lm_eval/tasks/mrl/gen/cmn_hant.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
cmn_hant
task
:
cmn_hant
dataset_name
:
cmn_hant
lm_eval/tasks/mrl/gen/deu_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
deu_latn
task
:
deu_latn
dataset_name
:
deu_latn
lm_eval/tasks/mrl/gen/dhd_deva.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
dhd_deva
task
:
dhd_deva
dataset_name
:
dhd_deva
lm_eval/tasks/mrl/gen/ekp_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ekp_latn
task
:
ekp_latn
dataset_name
:
ekp_latn
lm_eval/tasks/mrl/gen/ell_grek.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ell_grek
task
:
ell_grek
dataset_name
:
ell_grek
lm_eval/tasks/mrl/gen/eng_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
eng_latn
task
:
eng_latn
dataset_name
:
eng_latn
lm_eval/tasks/mrl/gen/est_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
est_latn
task
:
est_latn
dataset_name
:
est_latn
Prev
1
2
3
4
5
6
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment