Skip to content

GitLab

Commit 07ba1e68 authored by jon-tow's avatar jon-tow
Browse files

Format evaluator

parent f81db68e
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
lm_eval/evaluator.py
View file @ 07ba1e68
...@@ -226,6 +226,7 @@ def evaluate( ...@@ -226,6 +226,7 @@ def evaluate(
# Compare all tasks/sets at once to ensure a single training set scan # Compare all tasks/sets at once to ensure a single training set scan
if decontaminate: if decontaminate:
from lm_eval.decontamination.decontaminate import get_train_overlap from lm_eval.decontamination.decontaminate import get_train_overlap
print("Finding train/test overlap, please wait...") print("Finding train/test overlap, please wait...")
overlaps = get_train_overlap( overlaps = get_train_overlap(
docs_for_decontamination, decontamination_ngrams_path, limit docs_for_decontamination, decontamination_ngrams_path, limit
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment