Skip to content

GitLab

Commit 1701c4e2 authored by lintangsutawika's avatar lintangsutawika
Browse files

add warning log if prompt returns empty string

parent 722b8974
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
lm_eval/api/task.py
View file @ 1701c4e2
...@@ -766,6 +766,7 @@ class ConfigurableTask(Task): ...@@ -766,6 +766,7 @@ class ConfigurableTask(Task):
return applied_prompt[0] return applied_prompt[0]
else: else:
eval_logger.warning("Applied prompt returns empty string") eval_logger.warning("Applied prompt returns empty string")
return applied_prompt[0]
else: else:
print(type(doc_to_text)) print(type(doc_to_text))
raise TypeError raise TypeError
...@@ -800,6 +801,7 @@ class ConfigurableTask(Task): ...@@ -800,6 +801,7 @@ class ConfigurableTask(Task):
return applied_prompt[1] return applied_prompt[1]
else: else:
eval_logger.warning("Applied prompt returns empty string") eval_logger.warning("Applied prompt returns empty string")
return applied_prompt[0]
else: else:
raise TypeError raise TypeError
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment