Skip to content

GitLab

Unverified Commit 282b9e76 authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

Update ifeval.yaml (#1506)

parent a79a7c33
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
lm_eval/tasks/ifeval/ifeval.yaml
View file @ 282b9e76
...@@ -12,6 +12,7 @@ generation_kwargs: ...@@ -12,6 +12,7 @@ generation_kwargs:
temperature: 0.0 temperature: 0.0
max_gen_toks: 1280 max_gen_toks: 1280
process_results: !function utils.process_results process_results: !function utils.process_results
num_fewshot: 0
metric_list: metric_list:
- metric: prompt_level_strict_acc - metric: prompt_level_strict_acc
aggregation: mean aggregation: mean
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment