[bugfix] fix tsts (#9959)

Signed-off-by: youkaichao <youkaichao@gmail.com>

[bugfix] fix tsts (#9959)
Signed-off-by: youkaichao <youkaichao@gmail.com>
3bb4befe · youkaichao · GitHub · ae5279a1 · 3bb4befe · 3bb4befe
Unverified Commit 3bb4befe authored Nov 02, 2024 by youkaichao Committed by GitHub Nov 02, 2024
Show whitespace changes
Inline Side-by-side

Showing with 2 additions and 1 deletion

vllm/model_executor/model_loader/loader.py vllm/model_executor/model_loader/loader.py +1 -1

vllm/model_executor/models/utils.py vllm/model_executor/models/utils.py +1 -0

No files found.
--- a/vllm/model_executor/model_loader/loader.py
+++ b/vllm/model_executor/model_loader/loader.py
@@ -150,7 +150,7 @@ def _get_model_initialization_kwargs(


 def build_model(model_class: Type[nn.Module],
-                vllm_config: VllmConfig,
+                vllm_config: Optional[VllmConfig],
                hf_config: PretrainedConfig,
                cache_config: Optional[CacheConfig],
                quant_config: Optional[QuantizationConfig],

--- a/vllm/model_executor/models/utils.py
+++ b/vllm/model_executor/models/utils.py
@@ -252,6 +252,7 @@ def init_vllm_registered_model(

    return build_model(
        model_class,
+        None,
        hf_config,
        cache_config,
        quant_config,