Skip to content

GitLab

"tests/pipelines/controlnet_hunyuandit/__init__.py" did not exist on "f15f0cd2b50df9823c295f82f5f3e7fc8bf2cdcf"
Commit 03664188 authored by lintangsutawika's avatar lintangsutawika
Browse files

remove

parent e2dab32a
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 4 deletions
lm_eval/tasks/mmmu/_template_yaml
View file @ 03664188
...@@ -7,6 +7,8 @@ doc_to_target: "answer" ...@@ -7,6 +7,8 @@ doc_to_target: "answer"
# The return value of process_results will be used by metrics # The return value of process_results will be used by metrics
# process_results: !function utils.mmmu_process_results # process_results: !function utils.mmmu_process_results
# Note that the metric name can be either a registed metric function (such as the case for GQA) or a key name returned by process_results # Note that the metric name can be either a registed metric function (such as the case for GQA) or a key name returned by process_results
process_results: !function utils.mmmu_process_results
# Note that the metric name can be either a registed metric function (such as the case for GQA) or a key name returned by process_results
generation_kwargs: generation_kwargs:
until: until:
- "<|endoftext|>" - "<|endoftext|>"
...@@ -17,7 +19,6 @@ generation_kwargs: ...@@ -17,7 +19,6 @@ generation_kwargs:
repetition_penalty: 1.0 repetition_penalty: 1.0
image_aspect_ratio: original image_aspect_ratio: original
metric_list: metric_list:
- metric: exact_match - metric: mmmu_acc
# - metric: mmmu_acc aggregation: !function utils.mmmu_aggregate_results
# aggregation: !function utils.mmmu_aggregate_results higher_is_better: true
# higher_is_better: true \ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment