Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
f198094c
Commit
f198094c
authored
Jan 21, 2025
by
Baber
Browse files
nit
parent
b465d53f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
1 deletion
+0
-1
lm_eval/tasks/math500/math500.yaml
lm_eval/tasks/math500/math500.yaml
+0
-1
No files found.
lm_eval/tasks/math500/math500.yaml
View file @
f198094c
...
...
@@ -2,7 +2,6 @@ task: math500
dataset_path
:
HuggingFaceH4/MATH-500
process_docs
:
!function
utils.process_docs
output_type
:
generate_until
training_split
:
train
test_split
:
test
doc_to_text
:
"
Solve
the
following
math
problem
efficiently
and
clearly:
\n\n
-
For
simple
problems
(2
steps
or
fewer):
\n
Provide
a
concise
solution
with
minimal
explanation.
\n\n
-
For
complex
problems
(3
steps
or
more):
\n
Use
this
step-by-step
format:
\n\n
##
Step
1:
[Concise
description]
\n
[Brief
explanation
and
calculations]
\n\n
##
Step
2:
[Concise
description]
\n
[Brief
explanation
and
calculations]
\n\n
...
\n\n
Regardless
of
the
approach,
always
conclude
with:
\n\n
Therefore,
the
final
answer
is:
$
\\\\
boxed{answer}$.
I
hope
it
is
correct.
\n\n
Where
[answer]
is
just
the
final
number
or
expression
that
solves
the
problem.
\n\n
Problem:
{{
problem
}}"
process_results
:
!function
utils.process_results
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment