Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
flan_held_out.yaml 267 Bytes
Newer Older
lintangsutawika's avatar
added more flan subtasks  
lintangsutawika committed
1
2 
group: flan_held_out
task:
lintangsutawika's avatar
update benchmarks  
lintangsutawika committed
3
4
5 
  # BBH
  - bbh_flan_zeroshot
  - bbh_flan_fewshot
lintangsutawika's avatar
changed default to 5-shot  
lintangsutawika committed
6
7 
  - bbh_flan_cot_fewshot
  - bbh_flan_cot_zeroshot
lintangsutawika's avatar
update benchmarks  
lintangsutawika committed
8 
  # MMLU
lintangsutawika's avatar
changed default to 5-shot  
lintangsutawika committed
9 
  - mmlu
lintangsutawika's avatar
update benchmarks  
lintangsutawika committed
10
11 
  - mmlu_flan_n_shot_generative
  - mmlu_flan_n_shot_loglikelihood
lintangsutawika's avatar
changed default to 5-shot  
lintangsutawika committed
12
13 
  - mmlu_flan_cot_zeroshot
  - mmlu_flan_cot_fewshot