Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
37a6dbe2
"src/include/migraph/target.hpp" did not exist on "13a9d276250bd2d3c9fdd9ccf926d45fe820660b"
Commit
37a6dbe2
authored
Jul 12, 2024
by
lintangsutawika
Browse files
adjust naming
parent
75e3f993
Changes
60
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
24 additions
and
22 deletions
+24
-22
lm_eval/tasks/afrimgsm/en_cot/_afrimgsm_en_cot.yaml
lm_eval/tasks/afrimgsm/en_cot/_afrimgsm_en_cot.yaml
+4
-0
lm_eval/tasks/afrimgsm/en_cot/_cot_yaml
lm_eval/tasks/afrimgsm/en_cot/_cot_yaml
+2
-4
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_amh.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_amh.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_eng.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_eng.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ewe.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ewe.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_fra.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_fra.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_hau.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_hau.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ibo.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ibo.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_kin.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_kin.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lin.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lin.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lug.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lug.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_orm.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_orm.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sna.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sna.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sot.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sot.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_swa.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_swa.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_twi.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_twi.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_wol.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_wol.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_xho.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_xho.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_yor.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_yor.yaml
+1
-1
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_zul.yaml
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_zul.yaml
+1
-1
No files found.
lm_eval/tasks/afrimgsm/en_cot/_afrimgsm_en_cot.yaml
0 → 100644
View file @
37a6dbe2
group
:
afrimgsm_en_cot
group_alias
:
AfriMGSM Eng CoT
task
:
-
afrimgsm_en_cot_tasks
\ No newline at end of file
lm_eval/tasks/afrimgsm/en_cot/cot_yaml
→
lm_eval/tasks/afrimgsm/en_cot/
_
cot_yaml
View file @
37a6dbe2
# This file will be included in the generated language-specific task configs.
# It doesn't have a yaml file extension as it is not meant to be imported directly by the harness.
group:
- mgsm
- afrimgsm
- afrimgsm_en_cot
tag:
- afrimgsm_en_cot_tasks
dataset_path: masakhane/afrimgsm
dataset_name: null # Overridden by language-specific config.
output_type: generate_until
...
...
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_amh.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_amh
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_eng.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_eng
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ewe.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_ewe
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_fra.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_fra
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_hau.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_hau
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ibo.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_ibo
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_kin.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_kin
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lin.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_lin
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lug.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_lug
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_orm.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_orm
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sna.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_sna
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sot.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_sot
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_swa.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_swa
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_twi.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_twi
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_wol.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_wol
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_xho.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_xho
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_yor.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_yor
lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_zul.yaml
View file @
37a6dbe2
...
...
@@ -8,5 +8,5 @@ generation_kwargs:
-
'
Question:'
-
</s>
-
<|im_end|>
include
:
cot_yaml
include
:
_
cot_yaml
task
:
afrimgsm_en_cot_zul
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment