Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
bf2517cc
Commit
bf2517cc
authored
Feb 12, 2024
by
lintangsutawika
Browse files
update latest
parents
8bca751c
7397b965
Changes
113
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
140 additions
and
0 deletions
+140
-0
lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml
+7
-0
lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml
lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml
+7
-0
No files found.
lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_hi
dataset_path
:
alexandrainst/m_arc
dataset_name
:
hi
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_hr
dataset_path
:
alexandrainst/m_arc
dataset_name
:
hr
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_hu
dataset_path
:
alexandrainst/m_arc
dataset_name
:
hu
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_hy
dataset_path
:
alexandrainst/m_arc
dataset_name
:
hy
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_id
dataset_path
:
alexandrainst/m_arc
dataset_name
:
id
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_it
dataset_path
:
alexandrainst/m_arc
dataset_name
:
it
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_kn
dataset_path
:
alexandrainst/m_arc
dataset_name
:
kn
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_ml
dataset_path
:
alexandrainst/m_arc
dataset_name
:
ml
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_mr
dataset_path
:
alexandrainst/m_arc
dataset_name
:
mr
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_ne
dataset_path
:
alexandrainst/m_arc
dataset_name
:
ne
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_nl
dataset_path
:
alexandrainst/m_arc
dataset_name
:
nl
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_pt
dataset_path
:
alexandrainst/m_arc
dataset_name
:
pt
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_ro
dataset_path
:
alexandrainst/m_arc
dataset_name
:
ro
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_ru
dataset_path
:
alexandrainst/m_arc
dataset_name
:
ru
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_sk
dataset_path
:
alexandrainst/m_arc
dataset_name
:
sk
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_sr
dataset_path
:
alexandrainst/m_arc
dataset_name
:
sr
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_sv
dataset_path
:
alexandrainst/m_arc
dataset_name
:
sv
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_ta
dataset_path
:
alexandrainst/m_arc
dataset_name
:
ta
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_te
dataset_path
:
alexandrainst/m_arc
dataset_name
:
te
training_split
:
train
validation_split
:
validation
test_split
:
test
lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml
0 → 100644
View file @
bf2517cc
include
:
_arc_yaml
task
:
arc_uk
dataset_path
:
alexandrainst/m_arc
dataset_name
:
uk
training_split
:
train
validation_split
:
validation
test_split
:
test
Prev
1
2
3
4
5
6
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment