"composable_kernel/include/utility/array.hpp" did not exist on "0a2657312ec62a65e92a36cebd7d3b2a3c0712e1"
Unverified Commit c73b43f4 authored by Alexandre Marques's avatar Alexandre Marques Committed by GitHub
Browse files

Llama3 mmlu correction (#2797)

* Update continuation template YAML for MMLU task with new generation and filtering options

* Refactor filter_list structure in continuation template YAML for improved readability

* Add 'take_first' function to filter_list in continuation template YAML

* Update filter_list in continuation template YAML to use 'strict_match' and modify filtering functions

* Add 'do_sample' option to generation_kwargs in MMLU template YAML
parent 7478f971
...@@ -18,6 +18,7 @@ metric_list: ...@@ -18,6 +18,7 @@ metric_list:
- "\\$" - "\\$"
- "\\.$" - "\\.$"
generation_kwargs: generation_kwargs:
do_sample: false
until: until:
- "." - "."
max_gen_toks: 10 max_gen_toks: 10
......
...@@ -18,6 +18,7 @@ metric_list: ...@@ -18,6 +18,7 @@ metric_list:
- "\\$" - "\\$"
- "\\.$" - "\\.$"
generation_kwargs: generation_kwargs:
do_sample: false
until: until:
- "." - "."
max_gen_toks: 1024 max_gen_toks: 1024
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment