Skip to content

GitLab

Unverified Commit 294f8f66 authored by Tao He's avatar Tao He Committed by GitHub
Browse files

[BugFix] Pass tokenizer_config to local_tokenizer_group (#3754) 


Signed-off-by: default avatarTao He <sighingnow@gmail.com>
parent b95047f2
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/transformers_utils/tokenizer_group/ray_tokenizer_group.py
View file @ 294f8f66
...@@ -51,6 +51,7 @@ class RayTokenizerGroupPool(BaseTokenizerGroup): ...@@ -51,6 +51,7 @@ class RayTokenizerGroupPool(BaseTokenizerGroup):
enable_lora=enable_lora, enable_lora=enable_lora,
max_num_seqs=max_num_seqs, max_num_seqs=max_num_seqs,
max_input_length=max_input_length, max_input_length=max_input_length,
**tokenizer_config,
) )
ray_tokenizer_group_cls = ray.remote( ray_tokenizer_group_cls = ray.remote(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment