Skip to content

GitLab

Unverified Commit 948ab03e authored by ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟's avatar ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 Committed by GitHub
Browse files

[Bugfix][V1] Avoid importing PreTrainedModel (#15366) 


Signed-off-by: default avatarHollow Man <hollowman@opensuse.org>
parent 5797fb97
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/model_loader/utils.py
View file @ 948ab03e
...@@ -32,7 +32,7 @@ def set_default_torch_dtype(dtype: torch.dtype): ...@@ -32,7 +32,7 @@ def set_default_torch_dtype(dtype: torch.dtype):
def is_transformers_impl_compatible( def is_transformers_impl_compatible(
arch: str, arch: str,
module: Optional[transformers.PreTrainedModel] = None) -> bool: module: Optional["transformers.PreTrainedModel"] = None) -> bool:
mod = module or getattr(transformers, arch, None) mod = module or getattr(transformers, arch, None)
if mod is None: if mod is None:
return False return False
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment