Unverified Commit c73b43f4 authored by Alexandre Marques's avatar Alexandre Marques Committed by GitHub
Browse files

Llama3 mmlu correction (#2797)

* Update continuation template YAML for MMLU task with new generation and filtering options

* Refactor filter_list structure in continuation template YAML for improved readability

* Add 'take_first' function to filter_list in continuation template YAML

* Update filter_list in continuation template YAML to use 'strict_match' and modify filtering functions

* Add 'do_sample' option to generation_kwargs in MMLU template YAML
parent 7478f971
......@@ -18,6 +18,7 @@ metric_list:
- "\\$"
- "\\.$"
generation_kwargs:
do_sample: false
until:
- "."
max_gen_toks: 10
......
......@@ -18,6 +18,7 @@ metric_list:
- "\\$"
- "\\.$"
generation_kwargs:
do_sample: false
until:
- "."
max_gen_toks: 1024
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment