Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
flan_held_in.yaml 1.25 KB
Newer Older
lintangsutawika's avatar
moved benchmark up  
lintangsutawika committed
1
2
3
4
5
6
7 
group: flan_held_in
task:
  - include: flan/yaml_templates/held_in_template_yaml
    dataset_path: super_glue
    dataset_name: boolq
    use_prompt: flan/prompt_templates/flan_boolq.yaml:*
    validation_split: validation
lintangsutawika's avatar
added more flan subtasks  
lintangsutawika committed
8 
  - include: flan/yaml_templates/held_in_template_yaml
lintangsutawika's avatar
moved benchmark up  
lintangsutawika committed
9
10
11
12 
    dataset_path: super_glue
    dataset_name: rte
    use_prompt: flan/prompt_templates/flan_rte.yaml:*
    validation_split: validation
lintangsutawika's avatar
added more flan subtasks  
lintangsutawika committed
13 
  - include: flan/yaml_templates/held_in_template_yaml
lintangsutawika's avatar
moved benchmark up  
lintangsutawika committed
14
15
16
17 
    task: anli_r1
    dataset_path: anli
    use_prompt: flan/prompt_templates/flan_anli.yaml:*
    validation_split: dev_r1
lintangsutawika's avatar
added more flan subtasks  
lintangsutawika committed
18 
  - include: flan/yaml_templates/held_in_template_yaml
lintangsutawika's avatar
moved benchmark up  
lintangsutawika committed
19
20
21
22 
    task: anli_r2
    dataset_path: anli
    use_prompt: flan/prompt_templates/flan_anli.yaml:*
    validation_split: dev_r2
lintangsutawika's avatar
added more flan subtasks  
lintangsutawika committed
23 
  - include: flan/yaml_templates/held_in_template_yaml
lintangsutawika's avatar
moved benchmark up  
lintangsutawika committed
24
25
26
27 
    task: anli_r3
    dataset_path: anli
    use_prompt: flan/prompt_templates/flan_anli.yaml:*
    validation_split: dev_r3
lintangsutawika's avatar
update  
lintangsutawika committed
28
29
30
31
32
33
34
35
36
37 
  - include: flan/yaml_templates/held_in_template_yaml
    task: ai2_arc
    dataset_path: ARC-Easy
    use_prompt: local:*
    validation_split: validation
  - include: flan/yaml_templates/held_in_template_yaml
    task: ai2_arc
    dataset_path: ARC-Challange
    use_prompt: local:*
    validation_split: validation