Commit f3a82004 authored by lintangsutawika's avatar lintangsutawika
Browse files

Merge branch 'fix-metrics' of https://github.com/EleutherAI/lm-evaluation-harness into fix-metrics

parents 2f0ef6ca 45cc68ee
......@@ -7,8 +7,8 @@ output_type: greedy_until
training_split: train
validation_split: validation
doc_to_text: "{{passage}}\nQuestion: {{question}}?\nAnswer:"
doc_to_target: "{{[' no', ' yes'][label]}}"
target_delimiter: ""
doc_to_target: label
doc_to_choice: ['no', 'yes']
generation_kwargs:
until:
- "\n\n"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment