Skip to content

GitLab

Commit 5d43bb4b authored by Baber's avatar Baber
Browse files

chat_template bug

parent bebf7638
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/evaluator_judge.py
View file @ 5d43bb4b
...@@ -292,7 +292,7 @@ def simple_evaluate( ...@@ -292,7 +292,7 @@ def simple_evaluate(
model_source=model, model_source=model,
model_args=model_args, model_args=model_args,
system_instruction=system_instruction, system_instruction=system_instruction,
chat_template=lm.chat_template(apply_chat_template), chat_template=None,
fewshot_as_multiturn=fewshot_as_multiturn, fewshot_as_multiturn=fewshot_as_multiturn,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment