Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_mmmu.yaml 314 Bytes
Newer Older
Lintang Sutawika's avatar
Multimodal prototyping (#2243)  
Lintang Sutawika committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14 
group: mmmu_val
task:
  - mmmu_val_art_and_design
  - mmmu_val_business
  - mmmu_val_health_and_medicine
  - mmmu_val_humanities_and_social_science
  - mmmu_val_science
  - mmmu_val_tech_and_engineering
aggregate_metric_list:
  - metric: acc
    aggregation: mean
    weight_by_size: true
metadata:
  version: 0.0