Skip to content

GitLab

Unverified Commit 3bb4befe authored by youkaichao's avatar youkaichao Committed by GitHub
Browse files

[bugfix] fix tsts (#9959) 


Signed-off-by: default avataryoukaichao <youkaichao@gmail.com>
parent ae5279a1
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/model_executor/model_loader/loader.py
View file @ 3bb4befe
...@@ -150,7 +150,7 @@ def _get_model_initialization_kwargs( ...@@ -150,7 +150,7 @@ def _get_model_initialization_kwargs(
def build_model(model_class: Type[nn.Module], def build_model(model_class: Type[nn.Module],
vllm_config: VllmConfig, vllm_config: Optional[VllmConfig],
hf_config: PretrainedConfig, hf_config: PretrainedConfig,
cache_config: Optional[CacheConfig], cache_config: Optional[CacheConfig],
quant_config: Optional[QuantizationConfig], quant_config: Optional[QuantizationConfig],
......
vllm/model_executor/models/utils.py
View file @ 3bb4befe
...@@ -252,6 +252,7 @@ def init_vllm_registered_model( ...@@ -252,6 +252,7 @@ def init_vllm_registered_model(
return build_model( return build_model(
model_class, model_class,
None,
hf_config, hf_config,
cache_config, cache_config,
quant_config, quant_config,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment