Skip to content

GitLab

Unverified Commit a3691b6b authored by Alex Brooks's avatar Alex Brooks Committed by GitHub
Browse files

[Core][Frontend] Add Support for Inference Time mm_processor_kwargs (#9131) 


Signed-off-by: default avatarAlex-Brooks <Alex.Brooks@ibm.com>
parent 8c746226
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 1 deletion
vllm/worker/openvino_model_runner.py
View file @ a3691b6b
...@@ -172,7 +172,11 @@ class OpenVINOModelRunner: ...@@ -172,7 +172,11 @@ class OpenVINOModelRunner:
mm_data = seq_group_metadata.multi_modal_data mm_data = seq_group_metadata.multi_modal_data
if mm_data: if mm_data:
mm_kwargs = self.multi_modal_input_mapper(mm_data) mm_kwargs = self.multi_modal_input_mapper(
mm_data,
mm_processor_kwargs=seq_group_metadata.
mm_processor_kwargs,
)
multi_modal_inputs_list.append(mm_kwargs) multi_modal_inputs_list.append(mm_kwargs)
block_table = seq_group_metadata.block_tables[seq_id] block_table = seq_group_metadata.block_tables[seq_id]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment