dataset_name: salient_translation_error_detection
description: 'Detect the type of error in an English translation of a German source
  sentence.'
doc_to_choice: ["(A)","(B)","(C)","(D)","(E)","(F)"]
fewshot_config:
  sampler: first_n
  samples:
  - input: "The following translations from German to English contain a particular
      error. That error will be one of the following types: Named Entities: An entity
      (names, places, locations, etc.) is changed to a different entity. Numerical
      Values: Numerical values (ordinals or cardinals), dates, and/or units are changed.
      Modifiers or Adjectives: The modifiers and adjectives pertaining to a noun are
      changed. Negation or Antonyms: Introduce or remove a negation or change comparatives
      to their antonyms. Facts: Trivial factual errors not pertaining to the above
      classes are introduced in the translations. Dropped Content: A significant clause
      in the translation is removed. Please identify that error.  Source: In der Liste
      der Baudenkmale in Lenzen (Elbe) sind alle Baudenkmale der brandenburgischen
      Stadt Lenzen (Elbe) und ihrer Ortsteile aufgelistet.

      Translation: In the list of architectural monuments in Lenzen all architectural
      monuments of the Brandenburg city of Lenzen and its districts are listed.

      The translation contains an error pertaining to

      Options:

      (A) Modifiers or Adjectives

      (B) Numerical Values

      (C) Negation or Antonyms

      (D) Named Entities

      (E) Dropped Content

      (F) Facts"
    target: (D)
  - input: "The following translations from German to English contain a particular
      error. That error will be one of the following types: Named Entities: An entity
      (names, places, locations, etc.) is changed to a different entity. Numerical
      Values: Numerical values (ordinals or cardinals), dates, and/or units are changed.
      Modifiers or Adjectives: The modifiers and adjectives pertaining to a noun are
      changed. Negation or Antonyms: Introduce or remove a negation or change comparatives
      to their antonyms. Facts: Trivial factual errors not pertaining to the above
      classes are introduced in the translations. Dropped Content: A significant clause
      in the translation is removed. Please identify that error.  Source: Auf dieser
      Seite sind die Baudenkm\xE4ler der oberbayerischen Gro\xDFen Kreisstadt Landsberg
      am Lech zusammengestellt.

      Translation: On this page are compiled the architectural monuments of the town of
      Landsberg am Lech.

      The translation contains an error pertaining to

      Options:

      (A) Modifiers or Adjectives

      (B) Numerical Values

      (C) Negation or Antonyms

      (D) Named Entities

      (E) Dropped Content

      (F) Facts"
    target: (E)
  - input: "The following translations from German to English contain a particular
      error. That error will be one of the following types: Named Entities: An entity
      (names, places, locations, etc.) is changed to a different entity. Numerical
      Values: Numerical values (ordinals or cardinals), dates, and/or units are changed.
      Modifiers or Adjectives: The modifiers and adjectives pertaining to a noun are
      changed. Negation or Antonyms: Introduce or remove a negation or change comparatives
      to their antonyms. Facts: Trivial factual errors not pertaining to the above
      classes are introduced in the translations. Dropped Content: A significant clause
      in the translation is removed. Please identify that error.  Source: \u0141eba ist
      eine Kleinstadt und ein Badeort im Powiat L\u0119borski der polnischen Woiwodschaft
      Pommern.

      Translation: Eba is not a small town and seaside resort in the Powiat L\xE9borski
      county of the Pomeranian Voivodeship of Poland.\nThe translation contains an error
      pertaining to

      Options:

      (A) Modifiers or Adjectives

      (B) Numerical Values

      (C) Negation or Antonyms

      (D) Named Entities

      (E) Dropped Content

      (F) Facts"
    target: (C)
include: _fewshot_template_yaml
task: leaderboard_bbh_salient_translation_error_detection
