object_counting.yaml

dataset_name: object_counting
description: 'Questions that involve enumerating objects and asking the model to count
  them.


  '
doc_to_text: 'Q: {{input}}

  A: Let''s think step by step.

  '
fewshot_config:
  sampler: first_n
  samples:
  - input: I have a blackberry, a clarinet, a nectarine, a plum, a strawberry, a banana,
      a flute, an orange, and a violin. How many fruits do I have?
    target: 'Let''s think step by step.

      We first identify the fruits on the list and include their quantity in parentheses:

      - blackberry (1)

      - nectarine (1)

      - plum (1)

      - strawberry (1)

      - banana (1)

      - orange (1)

      Now, let''s add the numbers in parentheses: 1 + 1 + 1 + 1 + 1 + 1 = 6. So the
      answer is 6.'
  - input: I have an orange, a raspberry, two peaches, a blackberry, an apple, a grape,
      a nectarine, and three plums. How many fruits do I have?
    target: 'Let''s think step by step.

      We first identify the fruits on the list and include their quantity in parentheses:

      - orange (1)

      - raspberry (1)

      - peaches (2)

      - blackberry (1)

      - apple (1)

      - grape (1)

      - nectarine (1)

      - plums (3)

      Now, let''s add the numbers in parentheses: 1 + 1 + 2 + 1 + 1 + 1 + 1 + 3 =
      11. So the answer is 11.'
  - input: I have a lettuce head, a head of broccoli, an onion, a stalk of celery,
      two carrots, a garlic, and a yam. How many vegetables do I have?
    target: 'Let''s think step by step.

      We first identify the vegetables on the list and include their quantity in parentheses:

      - lettuce (1)

      - broccoli (1)

      - onion (1)

      - celery (1)

      - carrots (2)

      - garlic (1)

      - yam (1)

      Now, let''s add the numbers in parentheses: 1 + 1 + 1 + 1 + 2 + 1 + 1 = 8. So
      the answer is 8.'
include: _cot_fewshot_template_yaml
task: bbh_cot_fewshot_object_counting