Unverified Commit 6925cdbe authored by Isotr0py's avatar Isotr0py Committed by GitHub
Browse files

[Bugfix][Hardware][CPU] Fix `mm_limits` initialization for CPU backend (#7735)

parent 53328d75
...@@ -113,8 +113,10 @@ class CPUModelRunner(ModelRunnerBase[CPUModelInput]): ...@@ -113,8 +113,10 @@ class CPUModelRunner(ModelRunnerBase[CPUModelInput]):
) )
# Multi-modal data support # Multi-modal data support
self.multi_modal_input_mapper = MULTIMODAL_REGISTRY \ self.mm_registry = MULTIMODAL_REGISTRY
self.multi_modal_input_mapper = self.mm_registry \
.create_input_mapper(self.model_config) .create_input_mapper(self.model_config)
self.mm_registry.init_mm_limits_per_prompt(self.model_config)
# Lazy initialization. # Lazy initialization.
self.model: nn.Module # Set after init_Model self.model: nn.Module # Set after init_Model
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment