Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
7d09b24c
Commit
7d09b24c
authored
Jul 03, 2024
by
haileyschoelkopf
Browse files
fix alllll the merge conflicts
parents
96dfe976
6348b947
Changes
395
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
1 addition
and
65 deletions
+1
-65
lm_eval/tasks/agieval/gaokao-chemistry.yaml
lm_eval/tasks/agieval/gaokao-chemistry.yaml
+0
-3
lm_eval/tasks/agieval/gaokao-chinese.yaml
lm_eval/tasks/agieval/gaokao-chinese.yaml
+0
-3
lm_eval/tasks/agieval/gaokao-english.yaml
lm_eval/tasks/agieval/gaokao-english.yaml
+0
-3
lm_eval/tasks/agieval/gaokao-geography.yaml
lm_eval/tasks/agieval/gaokao-geography.yaml
+0
-3
lm_eval/tasks/agieval/gaokao-history.yaml
lm_eval/tasks/agieval/gaokao-history.yaml
+0
-3
lm_eval/tasks/agieval/gaokao-mathcloze.yaml
lm_eval/tasks/agieval/gaokao-mathcloze.yaml
+0
-3
lm_eval/tasks/agieval/gaokao-mathqa.yaml
lm_eval/tasks/agieval/gaokao-mathqa.yaml
+0
-3
lm_eval/tasks/agieval/gaokao-physics.yaml
lm_eval/tasks/agieval/gaokao-physics.yaml
+0
-3
lm_eval/tasks/agieval/jec-qa-ca.yaml
lm_eval/tasks/agieval/jec-qa-ca.yaml
+0
-3
lm_eval/tasks/agieval/jec-qa-kd.yaml
lm_eval/tasks/agieval/jec-qa-kd.yaml
+0
-3
lm_eval/tasks/agieval/logiqa-en.yaml
lm_eval/tasks/agieval/logiqa-en.yaml
+0
-4
lm_eval/tasks/agieval/logiqa-zh.yaml
lm_eval/tasks/agieval/logiqa-zh.yaml
+0
-3
lm_eval/tasks/agieval/lsat-ar.yaml
lm_eval/tasks/agieval/lsat-ar.yaml
+0
-4
lm_eval/tasks/agieval/lsat-lr.yaml
lm_eval/tasks/agieval/lsat-lr.yaml
+0
-4
lm_eval/tasks/agieval/lsat-rc.yaml
lm_eval/tasks/agieval/lsat-rc.yaml
+0
-4
lm_eval/tasks/agieval/math.yaml
lm_eval/tasks/agieval/math.yaml
+0
-3
lm_eval/tasks/agieval/sat-en-without-passage.yaml
lm_eval/tasks/agieval/sat-en-without-passage.yaml
+0
-4
lm_eval/tasks/agieval/sat-en.yaml
lm_eval/tasks/agieval/sat-en.yaml
+0
-4
lm_eval/tasks/agieval/sat-math.yaml
lm_eval/tasks/agieval/sat-math.yaml
+0
-4
lm_eval/tasks/anli/anli_r1.yaml
lm_eval/tasks/anli/anli_r1.yaml
+1
-1
No files found.
lm_eval/tasks/agieval/gaokao-chemistry.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_gaokao_chemistry
task
:
agieval_gaokao_chemistry
dataset_path
:
hails/agieval-gaokao-chemistry
dataset_path
:
hails/agieval-gaokao-chemistry
lm_eval/tasks/agieval/gaokao-chinese.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_gaokao_chinese
task
:
agieval_gaokao_chinese
dataset_path
:
hails/agieval-gaokao-chinese
dataset_path
:
hails/agieval-gaokao-chinese
lm_eval/tasks/agieval/gaokao-english.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_en
# categorizing as EN because the AGIEval codebase lists this as in `english_qa_tasks`
task
:
agieval_gaokao_english
task
:
agieval_gaokao_english
dataset_path
:
hails/agieval-gaokao-english
dataset_path
:
hails/agieval-gaokao-english
lm_eval/tasks/agieval/gaokao-geography.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_gaokao_geography
task
:
agieval_gaokao_geography
dataset_path
:
hails/agieval-gaokao-geography
dataset_path
:
hails/agieval-gaokao-geography
lm_eval/tasks/agieval/gaokao-history.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_gaokao_history
task
:
agieval_gaokao_history
dataset_path
:
hails/agieval-gaokao-history
dataset_path
:
hails/agieval-gaokao-history
lm_eval/tasks/agieval/gaokao-mathcloze.yaml
View file @
7d09b24c
group
:
-
agieval
-
agieval_cn
task
:
agieval_gaokao_mathcloze
task
:
agieval_gaokao_mathcloze
dataset_path
:
hails/agieval-gaokao-mathcloze
dataset_path
:
hails/agieval-gaokao-mathcloze
dataset_name
:
null
dataset_name
:
null
...
...
lm_eval/tasks/agieval/gaokao-mathqa.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_gaokao_mathqa
task
:
agieval_gaokao_mathqa
dataset_path
:
hails/agieval-gaokao-mathqa
dataset_path
:
hails/agieval-gaokao-mathqa
lm_eval/tasks/agieval/gaokao-physics.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_gaokao_physics
task
:
agieval_gaokao_physics
dataset_path
:
hails/agieval-gaokao-physics
dataset_path
:
hails/agieval-gaokao-physics
lm_eval/tasks/agieval/jec-qa-ca.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_jec_qa_ca
task
:
agieval_jec_qa_ca
dataset_path
:
hails/agieval-jec-qa-ca
dataset_path
:
hails/agieval-jec-qa-ca
lm_eval/tasks/agieval/jec-qa-kd.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_jec_qa_kd
task
:
agieval_jec_qa_kd
dataset_path
:
hails/agieval-jec-qa-kd
dataset_path
:
hails/agieval-jec-qa-kd
lm_eval/tasks/agieval/logiqa-en.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_nous
-
agieval_en
task
:
agieval_logiqa_en
task
:
agieval_logiqa_en
dataset_path
:
hails/agieval-logiqa-en
dataset_path
:
hails/agieval-logiqa-en
lm_eval/tasks/agieval/logiqa-zh.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_cn
task
:
agieval_logiqa_zh
task
:
agieval_logiqa_zh
dataset_path
:
hails/agieval-logiqa-zh
dataset_path
:
hails/agieval-logiqa-zh
lm_eval/tasks/agieval/lsat-ar.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_nous
-
agieval_en
task
:
agieval_lsat_ar
task
:
agieval_lsat_ar
dataset_path
:
hails/agieval-lsat-ar
dataset_path
:
hails/agieval-lsat-ar
lm_eval/tasks/agieval/lsat-lr.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_nous
-
agieval_en
task
:
agieval_lsat_lr
task
:
agieval_lsat_lr
dataset_path
:
hails/agieval-lsat-lr
dataset_path
:
hails/agieval-lsat-lr
lm_eval/tasks/agieval/lsat-rc.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_nous
-
agieval_en
task
:
agieval_lsat_rc
task
:
agieval_lsat_rc
dataset_path
:
hails/agieval-lsat-rc
dataset_path
:
hails/agieval-lsat-rc
lm_eval/tasks/agieval/math.yaml
View file @
7d09b24c
group
:
-
agieval
-
agieval_en
task
:
agieval_math
task
:
agieval_math
dataset_path
:
hails/agieval-math
dataset_path
:
hails/agieval-math
dataset_name
:
null
dataset_name
:
null
...
...
lm_eval/tasks/agieval/sat-en-without-passage.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_nous
-
agieval_en
task
:
agieval_sat_en_without_passage
task
:
agieval_sat_en_without_passage
dataset_path
:
hails/agieval-sat-en-without-passage
dataset_path
:
hails/agieval-sat-en-without-passage
lm_eval/tasks/agieval/sat-en.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_nous
-
agieval_en
task
:
agieval_sat_en
task
:
agieval_sat_en
dataset_path
:
hails/agieval-sat-en
dataset_path
:
hails/agieval-sat-en
lm_eval/tasks/agieval/sat-math.yaml
View file @
7d09b24c
include
:
aqua-rat.yaml
include
:
aqua-rat.yaml
group
:
-
agieval
-
agieval_nous
-
agieval_en
task
:
agieval_sat_math
task
:
agieval_sat_math
dataset_path
:
hails/agieval-sat-math
dataset_path
:
hails/agieval-sat-math
lm_eval/tasks/anli/anli_r1.yaml
View file @
7d09b24c
group
:
tag
:
-
anli
-
anli
task
:
anli_r1
task
:
anli_r1
dataset_path
:
anli
dataset_path
:
anli
...
...
Prev
1
2
3
4
5
6
…
20
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment