Update _mmlu_flan_cot_zeroshot_template_yaml

8c05c6be · Hailey Schoelkopf · GitHub · 4e34a6e8 · 8c05c6be
Unverified Commit 8c05c6be authored Dec 06, 2023 by Hailey Schoelkopf Committed by GitHub Dec 06, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml ...u/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml +1 -0

No files found.
--- a/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml
+++ b/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml
@@ -15,6 +15,7 @@ generation_kwargs:
    - "</s>"
  do_sample: false
  temperature: 0.0
+num_fewshot: 0
 metric_list:
  - metric: exact_match
    aggregation: mean