Skip to content

GitLab

Commit 89de5103 authored by lintangsutawika's avatar lintangsutawika
Browse files

add process for each subtask

parent 9bee4b4f
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 5 deletions
lm_eval/tasks/mmlu_pro/_default_template_yaml
View file @ 89de5103
...@@ -8,11 +8,11 @@ fewshot_config: ...@@ -8,11 +8,11 @@ fewshot_config:
output_type: generate_until output_type: generate_until
doc_to_text: !function utils.doc_to_text doc_to_text: !function utils.doc_to_text
doc_to_target: answer doc_to_target: answer
# filter_list: filter_list:
# - name: "custom-extract" - name: "custom-extract"
# filter: filter:
# - function: !function utils.CustomRegexFilter - function: !function utils.CustomRegexFilter
# - function: "take_first" - function: "take_first"
generation_kwargs: generation_kwargs:
until: until:
- "</s>" - "</s>"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment