"vscode:/vscode.git/clone" did not exist on "03f4110bd065b6a959f3d695e0f67c4e5025e399"
Unverified Commit 09e5f519 authored by Yen-Ting Lin's avatar Yen-Ting Lin Committed by GitHub
Browse files

Update lm_eval/tasks/tmlu/default/tmlu.yaml


Co-authored-by: default avatarLintang Sutawika <lintang@sutawika.com>
parent cd71c7f0
group: tmlu
group_alias: TMLU
task:
- tmlu_social_sciences
- tmlu_STEM
- tmlu_humanities
- tmlu_Taiwan Specific
- tmlu_other
- group: tmlu_social_sciences
group_alias: Social Sciences
task:
- tmlu_social_sciences_tasks
aggregate_metric_list:
- metric: acc
- group: tmlu_stem
group_alias: STEM
task:
- tmlu_stem_tasks
aggregate_metric_list:
- metric: acc
- group: tmlu_humanities
group_alias: Humanities
task:
- tmlu_humanities_tasks
aggregate_metric_list:
- metric: acc
- group: tmlu_taiwan_specific
group_alias: Taiwan Specific
task:
- tmlu_taiwan_specific_tasks
aggregate_metric_list:
- metric: acc
- group: tmlu_other
group_alias: Other
task:
- tmlu_other_tasks
aggregate_metric_list:
- metric: acc
aggregate_metric_list:
- metric: acc
metadata:
version: 1
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment