Skip to content

GitLab

Unverified Commit a30c0935 authored by Roger Wang's avatar Roger Wang Committed by GitHub
Browse files

[Bugfix] Add `mm_processor_kwargs` to chat-related protocols (#13644)

parent c7b07a95
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 0 deletions
vllm/entrypoints/openai/protocol.py
View file @ a30c0935
...@@ -974,6 +974,10 @@ class EmbeddingChatRequest(OpenAIBaseModel): ...@@ -974,6 +974,10 @@ class EmbeddingChatRequest(OpenAIBaseModel):
description=("Additional kwargs to pass to the template renderer. " description=("Additional kwargs to pass to the template renderer. "
"Will be accessible by the chat template."), "Will be accessible by the chat template."),
) )
mm_processor_kwargs: Optional[Dict[str, Any]] = Field(
default=None,
description=("Additional kwargs to pass to the HF processor."),
)
priority: int = Field( priority: int = Field(
default=0, default=0,
description=( description=(
...@@ -1394,6 +1398,10 @@ class TokenizeChatRequest(OpenAIBaseModel): ...@@ -1394,6 +1398,10 @@ class TokenizeChatRequest(OpenAIBaseModel):
description=("Additional kwargs to pass to the template renderer. " description=("Additional kwargs to pass to the template renderer. "
"Will be accessible by the chat template."), "Will be accessible by the chat template."),
) )
mm_processor_kwargs: Optional[Dict[str, Any]] = Field(
default=None,
description=("Additional kwargs to pass to the HF processor."),
)
@model_validator(mode="before") @model_validator(mode="before")
@classmethod @classmethod
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment