Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
584de690
Unverified
Commit
584de690
authored
Aug 04, 2025
by
Matthias Neumayer
Committed by
GitHub
Aug 04, 2025
Browse files
Update README.md for mlqa (#3117)
The tasks are called without .yaml just the task name
parent
edf3aa7a
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
50 additions
and
50 deletions
+50
-50
lm_eval/tasks/mlqa/README.md
lm_eval/tasks/mlqa/README.md
+50
-50
No files found.
lm_eval/tasks/mlqa/README.md
View file @
584de690
...
...
@@ -36,56 +36,56 @@ Homepage: `https://github.com/facebookresearch/MLQA`
#### Tasks
Tasks of the form
`mlqa_context-lang_question-lang
.yaml
`
*
`mlqa_ar_ar
.yaml
`
*
`mlqa_ar_de
.yaml
`
*
`mlqa_ar_vi
.yaml
`
*
`mlqa_ar_zh
.yaml
`
*
`mlqa_ar_en
.yaml
`
*
`mlqa_ar_es
.yaml
`
*
`mlqa_ar_hi
.yaml
`
*
`mlqa_de_ar
.yaml
`
*
`mlqa_de_de
.yaml
`
*
`mlqa_de_vi
.yaml
`
*
`mlqa_de_zh
.yaml
`
*
`mlqa_de_en
.yaml
`
*
`mlqa_de_es
.yaml
`
*
`mlqa_de_hi
.yaml
`
*
`mlqa_vi_ar
.yaml
`
*
`mlqa_vi_de
.yaml
`
*
`mlqa_vi_vi
.yaml
`
*
`mlqa_vi_zh
.yaml
`
*
`mlqa_vi_en
.yaml
`
*
`mlqa_vi_es
.yaml
`
*
`mlqa_vi_hi
.yaml
`
*
`mlqa_zh_ar
.yaml
`
*
`mlqa_zh_de
.yaml
`
*
`mlqa_zh_vi
.yaml
`
*
`mlqa_zh_zh
.yaml
`
*
`mlqa_zh_en
.yaml
`
*
`mlqa_zh_es
.yaml
`
*
`mlqa_zh_hi
.yaml
`
*
`mlqa_en_ar
.yaml
`
*
`mlqa_en_de
.yaml
`
*
`mlqa_en_vi
.yaml
`
*
`mlqa_en_zh
.yaml
`
*
`mlqa_en_en
.yaml
`
*
`mlqa_en_es
.yaml
`
*
`mlqa_en_hi
.yaml
`
*
`mlqa_es_ar
.yaml
`
*
`mlqa_es_de
.yaml
`
*
`mlqa_es_vi
.yaml
`
*
`mlqa_es_zh
.yaml
`
*
`mlqa_es_en
.yaml
`
*
`mlqa_es_es
.yaml
`
*
`mlqa_es_hi
.yaml
`
*
`mlqa_hi_ar
.yaml
`
*
`mlqa_hi_de
.yaml
`
*
`mlqa_hi_vi
.yaml
`
*
`mlqa_hi_zh
.yaml
`
*
`mlqa_hi_en
.yaml
`
*
`mlqa_hi_es
.yaml
`
*
`mlqa_hi_hi
.yaml
`
Tasks of the form
`mlqa_context-lang_question-lang`
*
`mlqa_ar_ar`
*
`mlqa_ar_de`
*
`mlqa_ar_vi`
*
`mlqa_ar_zh`
*
`mlqa_ar_en`
*
`mlqa_ar_es`
*
`mlqa_ar_hi`
*
`mlqa_de_ar`
*
`mlqa_de_de`
*
`mlqa_de_vi`
*
`mlqa_de_zh`
*
`mlqa_de_en`
*
`mlqa_de_es`
*
`mlqa_de_hi`
*
`mlqa_vi_ar`
*
`mlqa_vi_de`
*
`mlqa_vi_vi`
*
`mlqa_vi_zh`
*
`mlqa_vi_en`
*
`mlqa_vi_es`
*
`mlqa_vi_hi`
*
`mlqa_zh_ar`
*
`mlqa_zh_de`
*
`mlqa_zh_vi`
*
`mlqa_zh_zh`
*
`mlqa_zh_en`
*
`mlqa_zh_es`
*
`mlqa_zh_hi`
*
`mlqa_en_ar`
*
`mlqa_en_de`
*
`mlqa_en_vi`
*
`mlqa_en_zh`
*
`mlqa_en_en`
*
`mlqa_en_es`
*
`mlqa_en_hi`
*
`mlqa_es_ar`
*
`mlqa_es_de`
*
`mlqa_es_vi`
*
`mlqa_es_zh`
*
`mlqa_es_en`
*
`mlqa_es_es`
*
`mlqa_es_hi`
*
`mlqa_hi_ar`
*
`mlqa_hi_de`
*
`mlqa_hi_vi`
*
`mlqa_hi_zh`
*
`mlqa_hi_en`
*
`mlqa_hi_es`
*
`mlqa_hi_hi`
### Checklist
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment