Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
hyperbaton.yaml 766 Bytes
Newer Older
Clémentine Fourrier's avatar
Making hardcoded few shots compatible with the chat template mechanism (#1895)  
Clémentine Fourrier committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37 
dataset_name: hyperbaton
description: 'Order adjectives correctly in English sentences.


  '
doc_to_text: 'Q: {{input}}

  A:'
fewshot_config:
  sampler: first_n
  samples:
  - input: 'Which sentence has the correct adjective order:

      Options:

      (A) rubber terrible ship

      (B) terrible rubber ship'
    target: (B)
  - input: 'Which sentence has the correct adjective order:

      Options:

      (A) repulsive small Brazilian exercise ship

      (B) Brazilian repulsive exercise small ship'
    target: (A)
  - input: 'Which sentence has the correct adjective order:

      Options:

      (A) blue gold wonderful square shoe

      (B) wonderful square blue gold shoe'
    target: (B)
include: _fewshot_template_yaml
task: bbh_fewshot_hyperbaton