"megatron/training/arguments.py" did not exist on "4311b695c447d4c0223f8c5d903b82e55f9872fa"
_mmlu.yaml 136 Bytes
Newer Older
lintangsutawika's avatar
lintangsutawika committed
1
2
3
4
5
6
group: mmlu
task:
  - mmlu_stem
  - mmlu_other
  - mmlu_social_sciences
  - mmlu_humanities
lintangsutawika's avatar
lintangsutawika committed
7
8
aggregate_metric: True
weight_by_size: True