Skip to content

GitLab

"src/targets/gpu/jit/pad.cpp" did not exist on "360b1801207aba3d7f1c97aeb0dead85695ed3c8"
Commit 6e7c7897 authored by Baber's avatar Baber
Browse files

nit

parent f8e9fa1d
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 10 deletions
lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml
View file @ 6e7c7897
...@@ -55,16 +55,9 @@ tag: ...@@ -55,16 +55,9 @@ tag:
metadata: metadata:
version: 3.0 version: 3.0
metric_list: metric_list:
- aggregation: mean - metric: math_verify
aggregation: mean
higher_is_better: true higher_is_better: true
ignore_case: true
ignore_punctuation: false
metric: exact_match
regexes_to_ignore:
- ','
- \$
- '(?s).*#### '
- \.$
num_fewshot: 8 num_fewshot: 8
output_type: generate_until output_type: generate_until
repeats: 1 repeats: 1
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment