Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
459a5347
Commit
459a5347
authored
Aug 14, 2023
by
lintangsutawika
Browse files
edit gsm8k
parent
e414727a
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
8 additions
and
8 deletions
+8
-8
lm_eval/tasks/gsm8k/README.md
lm_eval/tasks/gsm8k/README.md
+8
-7
lm_eval/tasks/gsm8k/gsm8k.yaml
lm_eval/tasks/gsm8k/gsm8k.yaml
+0
-1
No files found.
lm_eval/tasks/gsm8k/README.md
View file @
459a5347
...
...
@@ -31,19 +31,20 @@ Homepage: https://github.com/openai/grade-school-math
}
```
###
Subt
asks
###
Groups and T
asks
-
`gsm8k_yaml`
-
`gsm8k_cot`
: GSM8K with Chain-of-Thought
-
`gsm8k_cot_self_consistency`
: GSM8K with Chain-of-Thought and Self-Consistency
#### Groups
### Groups
-
`greedy_until`
-
`math_word_problems`
-
`chain_of_thought`
-
`self_consistency`
#### Tasks
-
`gsm8k_yaml`
-
`gsm8k_cot`
: GSM8K with Chain-of-Thought
-
`gsm8k_cot_self_consistency`
: GSM8K with Chain-of-Thought and Self-Consistency
### Checklist
-
[x] Is in Eval-harness v1.0 ?
...
...
lm_eval/tasks/gsm8k/gsm8k.yaml
View file @
459a5347
group
:
-
greedy_until
-
math_word_problems
task
:
gsm8k_yaml
dataset_path
:
gsm8k
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment