Commit f3a82004 authored by lintangsutawika's avatar lintangsutawika
Browse files

Merge branch 'fix-metrics' of https://github.com/EleutherAI/lm-evaluation-harness into fix-metrics

parents 2f0ef6ca 45cc68ee
...@@ -7,8 +7,8 @@ output_type: greedy_until ...@@ -7,8 +7,8 @@ output_type: greedy_until
training_split: train training_split: train
validation_split: validation validation_split: validation
doc_to_text: "{{passage}}\nQuestion: {{question}}?\nAnswer:" doc_to_text: "{{passage}}\nQuestion: {{question}}?\nAnswer:"
doc_to_target: "{{[' no', ' yes'][label]}}" doc_to_target: label
target_delimiter: "" doc_to_choice: ['no', 'yes']
generation_kwargs: generation_kwargs:
until: until:
- "\n\n" - "\n\n"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment