Skip to content

GitLab

".github/vscode:/vscode.git/clone" did not exist on "a8c5413d06b417f9484d8723da308215a7eed922"
Unverified Commit 61b63da7 authored by Yifei Zhang's avatar Yifei Zhang Committed by GitHub
Browse files

Configure the pad tokens for Qwen when using vLLM (#2810)

parent 7158f4f4
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 5 deletions
lm_eval/models/vllm_causallms.py
View file @ 61b63da7
......@@ -125,7 +125,7 @@ class VLLM(TemplateLM):
revision=tokenizer_revision,
add_bos_token=add_bos_token,
)
self.tokenizer = configure_pad_token(self.tokenizer)
self.tokenizer = configure_pad_token(self.tokenizer, model_config=self._config)
self.add_bos_token = add_bos_token
if "gemma" in pretrained.lower():
self.add_bos_token = True
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment