Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
5b7ef05f
Commit
5b7ef05f
authored
Oct 14, 2025
by
Baber
Browse files
update mrl subsets
parent
2e8aa9c2
Changes
119
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
lm_eval/tasks/mrl/gen/pan_guru.yaml
lm_eval/tasks/mrl/gen/pan_guru.yaml
+1
-1
lm_eval/tasks/mrl/gen/pcm_latn.yaml
lm_eval/tasks/mrl/gen/pcm_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/pes_arab.yaml
lm_eval/tasks/mrl/gen/pes_arab.yaml
+1
-1
lm_eval/tasks/mrl/gen/pol_latn.yaml
lm_eval/tasks/mrl/gen/pol_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/por_latn_braz.yaml
lm_eval/tasks/mrl/gen/por_latn_braz.yaml
+1
-1
lm_eval/tasks/mrl/gen/por_latn_port.yaml
lm_eval/tasks/mrl/gen/por_latn_port.yaml
+1
-1
lm_eval/tasks/mrl/gen/ron_latn.yaml
lm_eval/tasks/mrl/gen/ron_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/rus_cyrl.yaml
lm_eval/tasks/mrl/gen/rus_cyrl.yaml
+1
-1
lm_eval/tasks/mrl/gen/rwr_deva.yaml
lm_eval/tasks/mrl/gen/rwr_deva.yaml
+1
-1
lm_eval/tasks/mrl/gen/sin_sinh.yaml
lm_eval/tasks/mrl/gen/sin_sinh.yaml
+1
-1
lm_eval/tasks/mrl/gen/slk_latn.yaml
lm_eval/tasks/mrl/gen/slk_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/slk_latn_sari.yaml
lm_eval/tasks/mrl/gen/slk_latn_sari.yaml
+1
-1
lm_eval/tasks/mrl/gen/slv_latn.yaml
lm_eval/tasks/mrl/gen/slv_latn.yaml
+1
-1
lm_eval/tasks/mrl/gen/slv_latn_cerk.yaml
lm_eval/tasks/mrl/gen/slv_latn_cerk.yaml
+1
-1
lm_eval/tasks/mrl/gen/snd_arab.yaml
lm_eval/tasks/mrl/gen/snd_arab.yaml
+1
-1
lm_eval/tasks/mrl/gen/snd_deva.yaml
lm_eval/tasks/mrl/gen/snd_deva.yaml
+1
-1
lm_eval/tasks/mrl/gen/spa_latn_mexi.yaml
lm_eval/tasks/mrl/gen/spa_latn_mexi.yaml
+1
-1
lm_eval/tasks/mrl/gen/spa_latn_peru.yaml
lm_eval/tasks/mrl/gen/spa_latn_peru.yaml
+1
-1
lm_eval/tasks/mrl/gen/spa_latn_spai.yaml
lm_eval/tasks/mrl/gen/spa_latn_spai.yaml
+1
-1
lm_eval/tasks/mrl/gen/srp_cyrl.yaml
lm_eval/tasks/mrl/gen/srp_cyrl.yaml
+1
-1
No files found.
lm_eval/tasks/mrl/gen/pan_guru.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
pan_guru
task
:
pan_guru
dataset_name
:
pan_guru
lm_eval/tasks/mrl/gen/pcm_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
pcm_latn
task
:
pcm_latn
dataset_name
:
pcm_latn
lm_eval/tasks/mrl/gen/pes_arab.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
pes_arab
task
:
pes_arab
dataset_name
:
pes_arab
lm_eval/tasks/mrl/gen/pol_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
pol_latn
task
:
pol_latn
dataset_name
:
pol_latn
lm_eval/tasks/mrl/gen/por_latn_braz.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
por_latn_braz
task
:
por_latn_braz
dataset_name
:
por_latn_braz
lm_eval/tasks/mrl/gen/por_latn_port.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
por_latn_port
task
:
por_latn_port
dataset_name
:
por_latn_port
lm_eval/tasks/mrl/gen/ron_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
ron_latn
task
:
ron_latn
dataset_name
:
ron_latn
lm_eval/tasks/mrl/gen/rus_cyrl.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
rus_cyrl
task
:
rus_cyrl
dataset_name
:
rus_cyrl
lm_eval/tasks/mrl/gen/rwr_deva.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
rwr_deva
task
:
rwr_deva
dataset_name
:
rwr_deva
lm_eval/tasks/mrl/gen/sin_sinh.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
sin_sinh
task
:
sin_sinh
dataset_name
:
sin_sinh
lm_eval/tasks/mrl/gen/slk_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
slk_latn
task
:
slk_latn
dataset_name
:
slk_latn
lm_eval/tasks/mrl/gen/slk_latn_sari.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
slk_latn_sari
task
:
slk_latn_sari
dataset_name
:
slk_latn_sari
lm_eval/tasks/mrl/gen/slv_latn.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
slv_latn
task
:
slv_latn
dataset_name
:
slv_latn
lm_eval/tasks/mrl/gen/slv_latn_cerk.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
slv_latn_cerk
task
:
slv_latn_cerk
dataset_name
:
slv_latn_cerk
lm_eval/tasks/mrl/gen/snd_arab.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
snd_arab
task
:
snd_arab
dataset_name
:
snd_arab
lm_eval/tasks/mrl/gen/snd_deva.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
snd_deva
task
:
snd_deva
dataset_name
:
snd_deva
lm_eval/tasks/mrl/gen/spa_latn_mexi.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
spa_latn_mexi
task
:
spa_latn_mexi
dataset_name
:
spa_latn_mexi
lm_eval/tasks/mrl/gen/spa_latn_peru.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
spa_latn_peru
task
:
spa_latn_peru
dataset_name
:
spa_latn_peru
lm_eval/tasks/mrl/gen/spa_latn_spai.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
spa_latn_spai
task
:
spa_latn_spai
dataset_name
:
spa_latn_spai
lm_eval/tasks/mrl/gen/srp_cyrl.yaml
View file @
5b7ef05f
include
:
'
_template'
task
:
mrl_gen_
srp_cyrl
task
:
srp_cyrl
dataset_name
:
srp_cyrl
Prev
1
2
3
4
5
6
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment