Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
a83874e5
Commit
a83874e5
authored
Jul 13, 2023
by
lintangsutawika
Browse files
adjust mathqa
parent
5dd41ebe
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
2 deletions
+1
-2
lm_eval/tasks/mathqa/mathqa.yaml
lm_eval/tasks/mathqa/mathqa.yaml
+1
-2
No files found.
lm_eval/tasks/mathqa/mathqa.yaml
View file @
a83874e5
...
...
@@ -7,10 +7,9 @@ output_type: multiple_choice
training_split
:
train
validation_split
:
validation
test_split
:
test
create_choices
:
!function
utils.create_choices
# create list of answer choices
doc_to_text
:
"
Question:
{{Problem}}
\n
Answer:"
doc_to_target
:
!function
utils.doc_to_target
gold_alias
:
"
{{['a',
'b',
'c',
'd',
'e'].index(correct)}}"
# this will be ca
st
t
o an
int.
create_choices
:
!function
utils.create_choices
# create li
st o
f
an
swer choices
metric_list
:
-
metric
:
acc
aggregation
:
mean
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment