Skip to content

GitLab

Commit a85e0150 authored by lintangsutawika's avatar lintangsutawika
Browse files

fixed stop token

parent cf4cd770
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml
View file @ a85e0150
...@@ -24,7 +24,7 @@ generation_kwargs: ...@@ -24,7 +24,7 @@ generation_kwargs:
- "</s>" - "</s>"
- "Q:" - "Q:"
- "<|im_end|>" - "<|im_end|>"
- "<0x0A>" - "\n"
metric_list: metric_list:
- metric: exact_match - metric: exact_match
aggregation: mean aggregation: mean
......
lm_eval/tasks/mmlu/generative/_default_template_yaml
View file @ a85e0150
...@@ -9,7 +9,7 @@ doc_to_target: "{{['A', 'B', 'C', 'D'][answer]}}" ...@@ -9,7 +9,7 @@ doc_to_target: "{{['A', 'B', 'C', 'D'][answer]}}"
generation_kwargs: generation_kwargs:
until: until:
- "</s>" - "</s>"
- "<0x0A>" - "\n"
metric_list: metric_list:
- metric: exact_match - metric: exact_match
aggregation: mean aggregation: mean
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment