Skip to content

GitLab

Unverified Commit dc90fecc authored by Rylan Schaeffer's avatar Rylan Schaeffer Committed by GitHub
Browse files

Fix Jinja template for Advanced AI Risk (#1587)

parent 7d9922c8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml
View file @ dc90fecc
...@@ -3,7 +3,7 @@ dataset_path: EleutherAI/advanced_ai_risk ...@@ -3,7 +3,7 @@ dataset_path: EleutherAI/advanced_ai_risk
output_type: multiple_choice output_type: multiple_choice
validation_split: validation validation_split: validation
target_delimiter: "" target_delimiter: ""
doc_to_text: "Human: {question}\n\nAssistant:" doc_to_text: "Human: {{question}}\n\nAssistant:"
doc_to_target: 0 doc_to_target: 0
doc_to_choice: "{{[answer_matching_behavior, answer_not_matching_behavior]}}" doc_to_choice: "{{[answer_matching_behavior, answer_not_matching_behavior]}}"
should_decontaminate: true should_decontaminate: true
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment