Skip to content

GitLab

Commit f4902e06 authored by Konrad's avatar Konrad
Browse files

tokenizer attribute check

parent 62df55d1
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/evaluator.py
View file @ f4902e06
...@@ -370,7 +370,7 @@ def evaluate( ...@@ -370,7 +370,7 @@ def evaluate(
cache_requests=cache_requests, cache_requests=cache_requests,
rewrite_requests_cache=rewrite_requests_cache, rewrite_requests_cache=rewrite_requests_cache,
apply_chat_template=apply_chat_template, apply_chat_template=apply_chat_template,
tokenizer=lm.tokenizer, tokenizer=lm.tokenizer if hasattr(lm, "tokenizer") else None,
) )
eval_logger.debug( eval_logger.debug(
f"Task: {task_output.task_name}; number of requests on this rank: {len(task.instances)}" f"Task: {task_output.task_name}; number of requests on this rank: {len(task.instances)}"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment