Skip to content

GitLab

"...resnet50_tensorflow.git" did not exist on "33fc3eebdc21821539bd1b17c3957f2184a9792c"
Commit 459a5347 authored by lintangsutawika's avatar lintangsutawika
Browse files

edit gsm8k

parent e414727a
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 8 deletions
lm_eval/tasks/gsm8k/README.md
View file @ 459a5347
...@@ -31,19 +31,20 @@ Homepage: https://github.com/openai/grade-school-math ...@@ -31,19 +31,20 @@ Homepage: https://github.com/openai/grade-school-math
} }
``` ```
### Subtasks ### Groups and Tasks
- `gsm8k_yaml` #### Groups
- `gsm8k_cot`: GSM8K with Chain-of-Thought
- `gsm8k_cot_self_consistency`: GSM8K with Chain-of-Thought and Self-Consistency
### Groups
- `greedy_until`
- `math_word_problems` - `math_word_problems`
- `chain_of_thought` - `chain_of_thought`
- `self_consistency` - `self_consistency`
#### Tasks
- `gsm8k_yaml`
- `gsm8k_cot`: GSM8K with Chain-of-Thought
- `gsm8k_cot_self_consistency`: GSM8K with Chain-of-Thought and Self-Consistency
### Checklist ### Checklist
- [x] Is in Eval-harness v1.0 ? - [x] Is in Eval-harness v1.0 ?
......
lm_eval/tasks/gsm8k/gsm8k.yaml
View file @ 459a5347
group: group:
- greedy_until
- math_word_problems - math_word_problems
task: gsm8k_yaml task: gsm8k_yaml
dataset_path: gsm8k dataset_path: gsm8k
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment