Skip to content

GitLab

Unverified Commit bc9df157 authored by Chirag Jain's avatar Chirag Jain Committed by GitHub
Browse files

Pass `tokenizer_revision` when getting tokenizer in openai serving (#4214)

parent 15b86408
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/entrypoints/openai/serving_engine.py
View file @ bc9df157
...@@ -68,6 +68,7 @@ class OpenAIServing: ...@@ -68,6 +68,7 @@ class OpenAIServing:
self.tokenizer = get_tokenizer( self.tokenizer = get_tokenizer(
engine_model_config.tokenizer, engine_model_config.tokenizer,
tokenizer_mode=engine_model_config.tokenizer_mode, tokenizer_mode=engine_model_config.tokenizer_mode,
tokenizer_revision=engine_model_config.tokenizer_revision,
trust_remote_code=engine_model_config.trust_remote_code, trust_remote_code=engine_model_config.trust_remote_code,
truncation_side="left") truncation_side="left")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment