Skip to content

GitLab

Unverified Commit 2135cacb authored by Isotr0py's avatar Isotr0py Committed by GitHub
Browse files

[Bugfix] Fix wrong multi_modal_input format for CPU runner (#5451)

parent 7d19de2e
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/worker/cpu_model_runner.py
View file @ 2135cacb
...@@ -343,8 +343,8 @@ class CPUModelRunner: ...@@ -343,8 +343,8 @@ class CPUModelRunner:
"kv_caches": kv_caches, "kv_caches": kv_caches,
"attn_metadata": attn_metadata, "attn_metadata": attn_metadata,
} }
if self.vision_language_config: if self.vision_language_config and multi_modal_input is not None:
execute_model_kwargs.update({"image_input": multi_modal_input}) execute_model_kwargs.update(multi_modal_input)
hidden_states = model_executable(**execute_model_kwargs) hidden_states = model_executable(**execute_model_kwargs)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment