Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
seq2seq.yaml 523 Bytes
Newer Older
lintangsutawika's avatar
added for seq2seq greedy_until test  
lintangsutawika committed
1 
group:
lintangsutawika's avatar
fixed super_glue and removed unused yaml config  
lintangsutawika committed
2 
  - super-glue-lm-eval-v1-seq2seq
lintangsutawika's avatar
added for seq2seq greedy_until test  
lintangsutawika committed
3
4
5
6
7
8 
task: "boolq-seq2seq"
dataset_path: super_glue
dataset_name: boolq
output_type: greedy_until
training_split: train
validation_split: validation
lintangsutawika's avatar
fixes to boolq  
lintangsutawika committed
9 
doc_to_text: "{{passage}}\nQuestion: {{question}}?\nAnswer:"
lintangsutawika's avatar
added warning regarding use of whitespace for target_delimiter and target, add...  
lintangsutawika committed
10 
doc_to_target: label
Lintang Sutawika's avatar
Update seq2seq.yaml  
Lintang Sutawika committed
11 
doc_to_choice: ['no', 'yes']
haileyschoelkopf's avatar
cleanup metric loading code  
haileyschoelkopf committed
12
13
14
15
16
17 
generation_kwargs:
  until:
    - "\n\n"
    - "\n"
  do_sample: false
  temperature: 0.0
lintangsutawika's avatar
added for seq2seq greedy_until test  
lintangsutawika committed
18
19
20
21
22
23 
metric_list:
  - metric: exact_match
    aggregation: mean
    higher_is_better: true
    ignore_case: true
    ignore_punctuation: true